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(57)Abstract: 

PROBLEM TO BE SOLVED: To easily provide image effect of high quality with light 
data. 

SOLUTION: An image inputting part 12 inputs a first image and a second image. A 
matching processor 14 performs pixel matching between those images, and a 
corresponding point on a lattice point of a mesh placed on the first image is obtained 
on the second image. A result is recorded as a corresponding point file F. An 
intermediate image generating part 18 generates an intermediate image between the 
first image and the second image on the basis of the corresponding point file F. 
Because the corresponding point file is created by only the lattice point, capacity of 
data is very small, and various image effect, animation compression, on-line goods 
introduction, and mounting on a portable apparatus are easily achieved. 
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CLAIMS 



[Claim(s)] 

[Claim 1] The image effectiveness approach characterized by including the process 
which detects the point on the 2nd image corresponding to the lattice point of the 
mesh prepared on the 1st image by image matching, and the process which defines 
the terminal point polygon corresponding to the origin polygon which constitutes the 
mesh on the 1st image on the 2nd image based on the result. 

[Claim 2] Said process to detect is a method according to claim 1 of performing 

matching count of a pixel unit between the 1st image and the 2nd image. 

[Claim 3] Said process to detect is a method according to claim 2 of performing 

matching count of a pixel unit based on correspondence with the singular point which 

detected by performing two-dimensional retrieval about the 1st image, and the 

singular point which detected by performing two-dimensional retrieval about the 2nd 

image. 

[Claim 4] Said process to detect is the approach according to claim 3 of acquiring the 
correspondence relation of the pixel unit in level with the final finest resolution, while 
succeeding to the matching count in resolution level which performs matching count 
of an image unit between the same resolution level, and is different in the result after 
forming the 1st image and the 2nd image into multiplex resolution by extracting said 
singular point, respectively. 

[Claim 5] Said process to define is an approach given in either of claims 1-4 which 
output the correspondence relation between an origin polygon and a terminal point 
polygon to a corresponding-points file, relate this file with the 1st image and the 2nd 
image, and hold it. 

[Claim 6] The approach according to claim 5 of including further the process which 
uses said corresponding-points file and generates the middle image of the 1st image 
and the 2nd image by interpolation count of a polygon unit. 

[Claim 7] Said process to generate is the approach according to claim 6 of deriving 
the point inside the terminal point polygon corresponding to the point inside an origin 
polygon. 

[Claim 8] The method according to claim 7 of dividing an origin polygon into a triangle 
and searching for the point inside a terminal point polygon in the internal division of 
the vector about three square shapes each. 

[Claim 9] This matching processor is the image effectiveness equipment 
characterized by generating a corresponding-points file including the image input 
section which acquires the 1st image and the 2nd image, and the matching processor 
which calculates matching of the 1st image and the 2nd image by defining the terminal 
point polygon corresponding to the origin polygon which constitutes the mesh on the 
1st image on the 2nd image. 



[Claim 10] Said matching processor is equipment according to claim 9 which performs 
matching count of a pixel unit based on correspondence with the singular point which 
detected by performing two-dimensional retrieval about the 1st image, and the 
singular point which detected by performing two-dimensional retrieval about the 2nd 
image. 

[Claim 1 1] Said matching processor is equipment according to claim 10 which acquires 
the correspondence relation of the pixel unit in level with the final finest resolution 
while succeeding to the matching count in resolution level which performs matching 
count of an image unit between the same resolution level, and is different in the result 
after forming the 1st image and the 2nd image into multiplex resolution by extracting 
said singular point, respectively. 

[Claim 12] Equipment given in either of claims 9-11 which include further the 
communications department for sending out said corresponding-points file to the 
exterior. 

[Claim 13] The image effectiveness equipment characterized by having described the 
physical relationship of the lattice point of a mesh when said corresponding-points file 
was taken on the 1st image, and the point on the 2nd image corresponding to it 
including the middle image generation section which acquires the 1st image, the 2nd 
image, and the corresponding-points file between them, and generates the middle 
image of these two images. 

[Claim 14] Equipment according to claim 13 which contains further the display which 
adjusts the timing of said middle image, said 1st image, and said 2nd image, and 
displays them. 

[Claim 15] The computer program characterized by making a computer perform the 
process which detects the point on the 2nd image corresponding to the lattice point 
of the mesh prepared on the 1st image by image matching, and the process which 
defines the terminal point polygon corresponding to the origin polygon which 
constitutes the mesh on the 1st image on the 2nd image based on the result. 
[Claim 16] the image interpolation approach which characterizes by to include the 
process which acquires the correspondence information on the origin polygon which 
constitutes the mesh prepared on the 1st image, and the terminal point polygon which 
constitute the mesh prepared on the 2nd image, the process which are alike also in 
the correspondence information and generate the middle image of the 1st image and 
the 2nd image, and the process which are in charge of generation of the middle image, 
and offer the goods presentation function in electronic commerce. 
[Claim 1 7] the image interpolation approach characterized by to include the process 
which acquires the correspondence information on the origin polygon which 
constitutes the mesh prepared on the 1st image, and the terminal point polygon which 
constitute the mesh prepared on the 2nd image, the process which are alike also in 
the correspondence information and generate the middle image of the 1st image and 



the 2nd image, and the process which are in charge of generation of the middle image, 
and offer the function about the image effectiveness. 

[Claim 18] the image interpolation approach characterized by to include the process 
which acquires the correspondence information on the origin polygon which 
constitutes the mesh prepared on the 1st image, and the terminal point polygon which 
constitute the mesh prepared on the 2nd image, the process which are alike also in 
the correspondence information and generate the middle image of the 1st image and 
the 2nd image, and the process which are in charge of generation of the middle image, 
and offer the utility feature about generation of a dynamic image. 
[Claim 19] the image interpolation approach characterized by to include the process 
which acquires the correspondence information on the origin polygon which 
constitutes the mesh prepared on the 1st image, and the terminal point polygon which 
constitute the mesh prepared on the 2nd image, the process which are alike also in 
the correspondence information and generate the middle image of the 1st image and 
the 2nd image, and the process which perform generation of the middle image under 
the function on condition of application to mobile computing devices. 
[Claim 20] Said goods presentation function is an approach including the function 
which rotates and displays goods according to the directions from a user according to 
claim 16. 

[Claim 21] Said goods presentation function is an approach including the function 
which displays the middle image which interpolated the goods image in the two 
directions and was obtained according to claim 16. 

[Claim 22] The function about said image effectiveness is an approach including the 
function which selects two images as the 1st image and the 2nd image one by one 
from three or more images, and displays a middle image continuously according to 
claim 17. 

[Claim 23] The function about said image effectiveness is an approach including the 
function which displays the middle image which interpolated the image set as the 
object of processing in the two directions, and was obtained according to claim 17. 
[Claim 24] Said utility feature is an approach including the function to specify the 
number of sheets of the middle image which should be generated according to claim 
18. 

[Claim 25] The assignment about the number of sheets of said middle image which 
should be generated is an approach according to claim 24 acquired from a user 
through GUI. 

[Claim 26] The function on condition of application to said mobile computing devices 
is the approach according to claim 1 9 of being the function which displays the middle 
image generated based on one side and said correspondence information on the 1st 
image or the 2nd image. 

[Claim 27] The approach according to claim 26 by which streaming processing of one 



side and said correspondence information on the 1st image or the 2nd image is carried 
out, and said middle image is generated. 

[Claim 28] Are equipment which interpolates an image and the correspondence 
information on the origin polygon which constitutes the mesh prepared on the 1st 
image, and the terminal point polygon which constitutes the mesh prepared on the 2nd 
image is acquired, the correspondence information — the image interpolation 
equipment characterized by the middle image generation section concerned being in 
charge of generation of a middle image, and offering the goods presentation function in 
electronic commerce including the middle image generation section which generates 
the middle image of the 1st image and the 2nd image on a basis. 

[Claim 29] Are equipment which interpolates an image and the correspondence 
information on the origin polygon which constitutes the mesh prepared on the 1st 
image, and the terminal point polygon which constitutes the mesh prepared on the 2nd 
image is acquired, the correspondence information — the image interpolation 
equipment characterized by the middle image generation section concerned being in 
charge of generation of a middle image, and offering the function about the image 
effectiveness including the middle image generation section which generates the 
middle image of the 1st image and the 2nd image on a basis. 

[Claim 30] Are equipment which interpolates an image and the correspondence 
information on the origin polygon which constitutes the mesh prepared on the 1st 
image, and the terminal point polygon which constitutes the mesh prepared on the 2nd 
image is acquired, the correspondence information — the image interpolation 
equipment characterized by the middle image generation section concerned being in 
charge of generation of a middle image, and offering the utility feature about 
generation of a dynamic image including the middle image generation section which 
generates the middle image of the 1st image and the 2nd image on a basis. 
[Claim 31] Are equipment which interpolates an image and the correspondence 
information on the origin polygon which constitutes the mesh prepared on the 1st 
image, and the terminal point polygon which constitutes the mesh prepared on the 2nd 
image is acquired, the correspondence information — the image interpolation 
equipment characterized by the middle image generation section concerned 
performing the display of a middle image under the function on condition of application 
to mobile computing devices including the middle image generation section which 
generates the middle image of the 1st image and the 2nd image on a basis. 
[Claim 32] Said goods presentation function is equipment including the function which 
rotates and displays goods according to the directions from a user according to claim 
28. 

[Claim 33] Said goods presentation function is equipment including the function which 
displays the middle image which interpolated the goods image in the two directions 
and was obtained according to claim 28. 



[Claim 34] The function about said image effectiveness is equipment including the 
function which selects two images as the 1st image and the 2nd image one by one 
from three or more images, and displays a middle image continuously according to 
claim 29. 

[Claim 35] The function about said image effectiveness is equipment including the 
function which displays the middle image which interpolated the image set as the 
object of processing in the two directions, and was obtained according to claim 29. 
[Claim 36] Said utility feature is equipment including the function to specify the 
number of sheets of the middle image which should be generated according to claim 
30. 

[Claim 37] The assignment about the number of sheets of said middle image which 
should be generated is equipment according to claim 36 acquired from a user through 
GUI. 

[Claim 38] The function on condition of application to said mobile computing devices 
is equipment according to claim 31 which is the function which displays the middle 
image generated based on one side and said correspondence information on the 1st 
image or the 2nd image. 

[Claim 39] Equipment according to claim 38 with which streaming processing of one 
side and said correspondence information on the 1st image or the 2nd image is carried 
out, and said middle image is generated. 

[Claim 40] Equipment given in either of claims 28-39 which contain further the display 
which adjusts the timing of said middle image, said 1st image, and said 2nd image, and 
displays them. 

[Claim 41] the computer program which characterizes by to make a computer perform 
the process which acquires the correspondence information on the origin polygon 
which constitutes the mesh prepared on the 1st image, and the terminal point polygon 
which constitute the mesh prepared on the 2nd image, the process which are alike 
also in the correspondence information and generate the middle image of the 1st 
image and the 2nd image, and the process which are in charge of generation of the 
middle image, and offer the goods presentation function in electronic commerce. 
[Claim 42] the computer program which characterizes by to make a computer perform 
the process which acquires the correspondence information on the origin polygon 
which constitutes the mesh prepared on the 1st image, and the terminal point polygon 
which constitute the mesh prepared on the 2nd image, the process which are alike 
also in the correspondence information and generate the middle image of the 1st 
image and the 2nd image, and the process which are in charge of generation of the 
middle image, and offer the function about the image effectiveness. 
[Claim 43] the computer program characterized by to make a computer perform the 
process which acquires the correspondence information on the origin polygon which 
constitutes the mesh prepared on the 1st image, and the terminal point polygon which 



constitute the mesh prepared on the 2nd image, the process which are alike also in 
the correspondence information and generate the middle image of the 1st image and 
the 2nd image, and the process which are in charge of generation of the middle image, 
and offer the utility feature about generation of a dynamic image. 
[Claim 44] The process which acquires the correspondence information on the origin 
polygon which constitutes the mesh prepared on the 1st image, and the terminal point 
polygon which constitutes the mesh prepared on the 2nd image, the computer 
program characterized by making a computer perform the process which is alike also 
in the correspondence information and generates the middle image of the 1st image 
and the 2nd image, and the process which performs generation of the middle image 
under the function on condition of application to mobile computing devices. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] Especially this invention relates to the digital image 

effectiveness technique about an image processing technique. 

[0002] 

[Description of the Prior Art] BS digital broadcasting greets the timing of initiation, 
and many users come to enjoy the service on the Internet from PC or a gestalt 
telephone, and the fence of broadcast and a communication link is collapsing quickly, 
in a broadband time, multimedia culture accomplishes true progress — will come out 
and I will be — it carries out, and conflicts in it and distribution of a reason animation 
serves as key technology. In the amount of the information which human being 
acquires from the external world, an image is said to be able to transmit 200 times as 
many contents as voice. An image does not remain in an amusement application but 
serves as a life of human being and a software infrastructure supporting culture widely. 
The place of activity of the image effectiveness technique also spreads by application 
of CG or an image processing technique as an image is digitized. 
[0003] 

[Problem(s) to be Solved by the Invention] Before, various image effectiveness is 
proposed and used. For example, it is walk-through, multiaspect image, special filtering, 
and false stereoscopic vision etc. To be accompanied by the high data compression 
effectiveness is desired so that such image effectiveness may be offered with higher 
quality and it may fill the request of a transmission system to coincidence, as the 
importance in the society of an image will increase further from now on. This invention 
is made to such a request and one of the purpose of that is in offer of the image 



effectiveness technique in which comparatively light data realize generation of an 
animation. Another purpose of this invention is in offer of the image interpolation 
technique of realizing various imaging technology not only in the image effectiveness 
but digital one and the Internet age. 
[0004] 

[Means for Solving the Problem] The mode with this invention includes the process 
which detects the point on the 2nd image corresponding to the lattice point of the 
mesh prepared on the 1st image by image matching, and the process which defines 
the terminal point polygon corresponding to the origin polygon which constitutes the 
mesh on the 1st image on the 2nd image based on the result. 

[0005] The process to detect may perform matching count of a pixel unit between the 
1st image and the 2nd image. This count may follow all pixels and may follow the pixel 
relevant to the lattice point or the lattice point and it. 

[0006] The process to detect may perform matching count of a pixel unit based on 
correspondence with the singular point which detected by performing 
two-dimensional retrieval about the 1st image, and the singular point which detected 
by performing two-dimensional retrieval about the 2nd image. In this case, further, 
after forming the 1st image and the 2nd image into multiplex resolution by extracting 
the singular point, respectively, the process to detect performs matching count of an 
image unit between the same resolution level, and it may acquire the correspondence 
relation of the pixel unit in level with the final finest resolution, succeeding to the 
matching count in resolution level which is different in that result. 
[0007] The process to define outputs the correspondence relation between an origin 
polygon and a terminal point polygon to a corresponding-points file, may relate this file 
with the 1st image and the 2nd image, and may hold it. Moreover, this invention may 
use a corresponding-points file and may also include further the process which 
generates the middle image of the 1st image and the 2nd image by interpolation count 
of a polygon unit. 

[0008] These people are application of the technique (henceforth a "premise 
technique") previously proposed by patent No. 2927350, and are suitable for the 
matching approach using the above-mentioned singular point at said process to 
detect. However, the premise technique is not touching at all the description of this 
invention about the polygon decided by the lattice point or it. Since a kind of 
simplification technique of a polygon was introduced by this invention, size of said 
corresponding-points file can be made very small. 

[0009] That is, if correspondence of those pixel units is described as it is when the 1st 
and 2nd image has a nxm pixel, respectively, the combination 2 (nxm) will arise and a 
corresponding-points file will become the huge amount of data. However, the amount 
of data becomes less sharply by changing this into describing the correspondence 
relation of the lattice points, or the correspondence relation of polygons decided by 



the lattice point although it is the same substantially. 

[0010] On the other hand, if there are the 1st and 2nd image and this 
corresponding-points file, a middle image is generable by interpolation count. 
Therefore, this invention realizes morphing as used in the field of the image 
effectiveness. If the 1st and 2nd image is considered [ both ] to be a frame in an 
animation, this invention can be grasped as the compression technology of an 
animation instead of morphing. Therefore, if only the 1st and 2nd image and a 
corresponding-points file are held, an animation can be reproduced and big 
effectiveness will be demonstrated in transmission of an animation, storage, etc. 
[0011] Another mode of this invention is related with the image effectiveness 
equipment. This matching processor generates a corresponding-points file including 
the image input section from which this equipment acquires the 1st image and the 2nd 
image, and the matching processor which calculates matching of the 1st image and 
the 2nd image by defining the terminal point polygon corresponding to the origin 
polygon which constitutes the mesh on the 1st image on the 2nd image. 
[0012] A matching processor may perform matching count of a pixel unit based on 
correspondence with the singular point which detected by performing 
two-dimensional retrieval about the 1st image, and the singular point which detected 
by performing two-dimensional retrieval about the 2nd image. Moreover, after forming 
the 1st image and the 2nd image into multiplex resolution by extracting said singular 
point, respectively, matching count of an image unit is performed between the same 
resolution level, and the correspondence relation of the pixel unit in level with the final 
finest resolution may be acquired, succeeding to the matching count in resolution 
level which is different in the result. 

[0013] Further, this equipment could acquire the 1st image, the 2nd image, and the 
corresponding-points file between them, and may describe the physical relationship of 
the lattice point of a mesh when said corresponding-points file was taken on the 1st 
image, and the point on the 2nd image corresponding to it including the middle image 
generation section which generates the middle image of these two images. Moreover, 
the display which adjusts the timing of a middle image, the 1st image, and the 2nd 
image, and displays them may also be included further. In addition, in a premise 
technique, this invention does not have an end as it is indispensable. 
[0014] A mode is related with another pan of this invention at the image interpolation 
approach, this approach includes the process which acquires the correspondence 
information on the origin polygon which constitutes the mesh prepared on the 1st 
image, and the terminal point polygon which constitute the mesh prepared on the 2nd 
image, the process which are alike also in that correspondence information and 
generate the middle image of the 1st image and the 2nd image, and the process which 
are in charge of generation of that middle image, and offer the goods presentation 
function in electronic commerce. 



[0015] It may replace with the function and the function about the image 
effectiveness and the utility feature about generation of a dynamic image may be 
offered. Moreover, the display of a middle image may be performed under the function 
on condition of application to mobile computing devices. 

[0016] A goods presentation function may also include the function which rotates and 
displays goods according to the directions from a user. Moreover, you may also 
include the function which displays the middle image which interpolated the goods 
image up and down with two directions, for example, right and left, and was obtained. 
[0017] The function about the image effectiveness may also include the function 
which selects two images as the 1st image and the 2nd image one by one from three 
or more images, and displays a middle image continuously. For example, a panoptic 
image will be obtained, if between many discrete view images is interpolated one after 
another and a middle image is generated. If it displays in order as if it moved the view 
with time amount, a walk-through image will be obtained. The function about the image 
effectiveness may also include the function which displays the middle image which 
interpolated the image set as the object of processing in the two directions, and was 
obtained. 

[0018] The utility feature about an animation may also include the function to specify 
the number of sheets of the middle image which should be generated. If many middle 
images are generated, a slow motion image is generable, for example. By specifying 
number of sheets, the way of setting up the reproduction speed of an animation 
interactively is opened. The assignment about the number of sheets of the middle 
image which should be generated may be acquired from a user through GUI. 
[0019] The function on condition of application to mobile computing devices may be a 
function which displays the middle image generated based on one side and said 
correspondence information on the 1st image or the 2nd image. In that case, there is 
little capacity of the memory for setting an image temporary, and it ends. What is 
necessary is just to move the image element (for it to be made to only represent with 
a pixel below) of each pixel and others of the 1st image according to correspondence 
information, when only correspondence information and the 1st image generate a 
middle image. That is, although both the location of a pixel and a pixel value, i.e., a 
color, can usually be interpolated for correspondence information, this is simplified to 
processing of only migration of the location of a pixel. Of course, it is also possible to 
include the color information on the pixel of the 2nd image in the correspondence 
information itself, and both the location of a pixel and a color can interpolate good in 
that case. 

[0020] Streaming processing of one side and said correspondence information on the 
1st image or the 2nd image is carried out, and a middle image may be generated. The 
capacity of memory required for processing may be reduced also in this case, and it is 
advantageous to mounting to the terminal of a cellular phone and others. 



[0021] Still more nearly another mode of this invention is equipment which 
interpolates an image, and the correspondence information on the origin polygon 
which constitutes the mesh prepared on the 1 st image, and the terminal point polygon 
which constitutes the mesh prepared on the 2nd image is acquired, the 
correspondence information — including the middle image generation section which 
generates the middle image of the 1st image and the 2nd image on a basis, the middle 
image generation section concerned is in charge of generation of a middle image, and 
offers the goods presentation function in electronic commerce. In addition, the 
function about the image effectiveness, the utility feature about generation of a 
dynamic image, and the function on condition of application to mobile computing 
devices may be offered. 

[0022] This equipment may also contain the display which adjusts the timing of a 

middle image, the 1st image, and the 2nd image, and displays them further. 

[0023] In addition, a part or the thing which replaced all, added or changed the 

expression into the computer program, the record medium, etc. is also effective in an 

expression as this invention between an approach and equipment in changing each 

above configuration and a process to arbitration. 

[0024] 

[Embodiment of the Invention] First, the image matching processing using the 
multiplex resolution singular point filter technique and it which are used with the 
gestalt of operation is explained in full detail as a "premise technique." These 
techniques are techniques in which these people have already acquired patent No. 
2927350, and are suitable for combination with this invention. Since a mesh is 
prepared on an image and many pixels are represented with this invention by the 
lattice point, it is because the application effectiveness over the matching technique 
of a pixel unit like a premise technique from the first is high. However, an image 
matching technique employable with the gestalt of operation is not restricted to this. 
[0025] The image interpolation technique and the image effectiveness technique 
which the premise technique was used are concretely explained after drawing 18 . 
[the background of a premise technique] — matching of automatic matching of two 
images, i.e., an image field, and pixels is one of the most difficult and, important themes 
in a computer vision or computer graphics. For example, if matching can be taken 
between the images from a different view about a certain object, the image from other 
views is generable. If matching of a right eye image and a left eye image is calculable, 
the photogrammetry using a solid image is also possible. When matching of the model 
of the image of a face and the image of other faces is able to be taken, the part of 
characteristic faces, such as an eye, a nose, and opening, can be extracted. For 
example, when matching is correctly taken between the images of people's face and 
the face of a cat, morphing can be automated fully by generating the inside rate image 
of them automatically. 



[0026] However, conventionally, people had to specify the corresponding points 
between two images one by one, and, generally they required the great activity man 
day. In order to solve this problem, many corresponding-points automatic detection 
approaches are proposed. For example, there is an idea of reducing the number of the 
candidates of corresponding points, by using an epipolar straight line. However, 
processing is very complicated even in such a case. In order to reduce complexity, it 
is assumed that the coordinate of each point of a left eye image is usually in the 
location almost same as a right eye image. However, if such constraint is prepared, it 
will become very difficult to take matching which fulfills the global description and the 
local description to coincidence. 

[0027] In volume rendering, since the voxel is constituted, a series of cross-section 
images are used. In this case, conventionally, it is assumed that it corresponds to 
general with the pixel which has a pixel in an upper cross-section image in the same 
part of a downward cross-section image, and the pair of these pixels is used for 
interpolation count. Thus, in order to use a very simple approach, when a long distance 
and the cross-section configuration of an object are large and the distance between 
continuous cross sections changes, the object built by volume rendering tends to 
become not clear. 

[0028] A stereophotogrammetry method etc. also has many matching algorithms using 
detection of an edge. However, since there are few corresponding points obtained as a 
result in this case, interpolation count of the value of disparity must be carried out in 
order to bury the gap between the corresponding points which were able to take 
matching. Generally, when the brightness of a pixel changes in the local window which 
they use, it is difficult for all edge detectors to judge whether this suggests existence 
of an edge truly. An edge detector is a high-pass filter altogether essentially, and a 
noise will also gather it to an edge and coincidence. 

[0029] The optical flow is known as still more nearly another technique. When the 
image of two sheets is given, in an optical flow, a motion of the object in an image 
(rigid body) is detected. It is assumed in that case that the brightness of each pixel of 
an object does not change. In an optical flow, the motion vector (u, v) of each pixel is 
calculated with some additional conditions of the smoothness of vector field (u, v). 
However, in an optical flow, the global correspondence relation between images is 
undetectable. It is only taking notice of a local change of the brightness of a pixel, and 
the error of a system becomes remarkable when the variation rate of an image is large. 
[0030] In order to recognize the global structure of an image, many multiplex 
resolution filters have also been proposed. They are classified into a linearity filter and 
a nonlinear filter. Although there is wavelet as a former example, generally a linearity 
filter is not very useful to image matching. Because, it is because the information 
about the brightness of the pixel which takes extremal value becomes indistinct 
gradually with those positional information. Drawing 1 (a) and drawing 1 (b) show the 



result of having applied the equalization filter to the image of a face. While the 
brightness of the pixel which takes extremal value as shown in this drawing fades 
gradually by equalization, the location is also shifted under the effect of equalization. 
Consequently, neither the brightness of an eye (the minimum point of brightness) nor 
the information on a location can become ambiguous on such coarse resolution level, 
and cannot calculate right matching in this resolution. Therefore, though it is for global 
matching preparing coarse resolution level, matching obtained here does not 
correspond to the true description (an eye, i.e., the minimum point) of an image 
correctly. Even if an eye appears vividly on more minute resolution level, recovery 
does not attach any longer the error mixed when taking global matching. By adding 
smoothing processing to an input image, it is also already pointed out that the 
stereophonic information of a texture field falls. 

[0031] On the other hand, there is a "screen (sieve)" operator of a single dimension 
as a nonlinear filter which began to be used in the field of geomorphology recently. 
This operator adds smoothing processing to an image by choosing the minimal value in 
the single dimension window of predetermined magnitude (or maximal value), saving 
the causal relation of a scale and space. Although the image obtained as a result is the 
same magnitude as the original image, since the component of a small wave is 
removed, it becomes simpler. Although this operator can be classified into the 
"multiplex resolution filter" in large semantics in that the information on an image is 
dropped, an image is not necessarily (it being got blocked and not being a multiplex 
resolution filter in narrow semantics) hierarchized, changing the resolution of an image 
like wavelet in fact, and it cannot use for detection of correspondence between 
images. 

[0032] If beyond [the technical problem which a premise technique tends to solve] is 
summarized, the following technical problems will be accepted. 

1. The image-processing approach of grasping the description of an image by 
comparatively easy processing correctly was scarce. There were few effective 
proposals about the image-processing approach that the description can be extracted 
maintaining the information about an especially characteristic point, for example, a 
pixel value, and a location. 

2. When corresponding points were detected automatically based on the description of 
an image, there was a fault, like generally processing is complicated or noise 
resistance is low. Moreover, it was difficult to take matching which needs to prepare 
various constraint on the occasion of processing, and fulfills the global description and 
the local description to coincidence. 

3. In order to recognize the global structure or the global description of an image, even 
if it introduced the multiplex resolution filter, when the filter was a linearity filter, the 
brightness information and positional information of a pixel became ambiguous. 
Consequently, grasp of corresponding points tended to become incorrectness. Since 



the single dimension screen operator which is a nonlinear filter did not hierarchize an 
image, it was not applicable to detection of the corresponding points between images. 
4. When it was going to grasp corresponding points correctly these results, it 
depended on assignment by the help after all, and also there were no effective means. 
[0033] A premise technique is made for the purpose of solution of these technical 
problems, and offers the technique which enables exact grasp of the description of an 
image in the field of an image processing. 

[0034] [ — a premise technique — The means for solving a technical problem] — the 
mode which has a premise technique for this purpose proposes the image filter of new 
multiplex resolution. This multiplex resolution filter extracts the singular point from an 
image. Therefore, it is also called a singular point filter. The singular point means a 
point with the image top description. About the maximum point that a pixel value (a 
pixel value points out numeric values of the arbitration about an image or a pixel, such 
as a color number number and a brightness value) becomes max in a certain field as 
an example, the minimum point which becomes min, and a certain direction, although it 
is max, there is the saddle point which becomes min about another direction. The 
singular point may be a concept on topology. It may correct, in addition you may have 
what kind of description. It is not an essential problem for a premise technique of what 
kind of property a point is considered to be the singular point. 

[0035] In this mode, the image processing which used the multiplex resolution filter is 
performed. First, in a detection process, to the first image, two-dimensional retrieval 
is performed and the singular point is detected. Next in a generation process, the 
detected singular point is extracted, and the second image with resolution lower than 
the first image is generated. The singular point which the first image has is taken over 
to the second image. Since resolution is lower than the first image, the second image 
is suitable for grasp of the global description of an image. 

[0036] Another mode of a premise technique is related with the image matching 
approach of having used the singular point filter. In this mode, matching between a 
starting point image and a terminal point image is taken. A starting point image and a 
terminal point image are the names conferred for convenience because of distinction 
of two images, and there is no essential difference. 

[0037] In this mode, a series of starting point hierarchy images with which a singular 
point filter is given to a starting point image, and resolution differs at the first process 
are generated. At the second process, a series of terminal point hierarchy images with 
which a singular point filter is given to a terminal point image, and resolution differs are 
generated. A starting point hierarchy image and a terminal point hierarchy image mean 
the image group which hierarchizes a starting point image and a terminal point image, 
respectively, and is obtained, and it consists of an image of at least two sheets, 
respectively. Next in the third process, matching of a starting point hierarchy image 
and a terminal point hierarchy image is calculated in the hierarchy of resolution level. 



Since according to this mode the description of the image relevant to the singular 
point is extracted by the multiplex resolution filter and/or it is clarified, matching 
becomes easy. Especially the constraint for matching is not needed. 
[0038] Still more nearly another mode of a premise technique is also related with 
matching of a starting point image and a terminal point image. A valuation plan is 
beforehand formed about each of two or more matching evaluation criteria, those 
valuation plans are unified, and this mode defines a comprehensive valuation plan, and 
is searched for the optimal matching paying attention to near the extremal value of 
that comprehensive valuation plan. A comprehensive valuation plan may be defined as 
total of those valuation plans, after [ of a valuation plan ] hanging a multiplier 
parameter on one at least, it may detect the condition that a comprehensive valuation 
plan or one of valuation plans take extremal value mostly in that case, and may 
determine said parameter. It is because the error may be included "near extremal 
value" or to have presupposed [ some ] "Extremal value is taken mostly." Some 
errors do not very pose a problem at a premise technique. 

[0039] In order for the extremal value itself to be dependent on said parameter, room 
to determine the parameter considered to be the optimal based on the behavior of 
extremal value, i.e., the situation of change of extremal value, arises. This mode uses 
that fact. According to this mode, the way which automates the decision of the 
difficult parameter of adjustment originally is cultivated. 

[0040] The component engineering of a premise technique explains in full detail by [1] 
to the [gestalt of operation of premise technique] beginning, and [2] explains 
procedure concretely. Furthermore, [3] reports the result of an experiment. 
[0041] [1] Introduce the new multiplex resolution filter called the detail [1.1] 
introduction singular point filter of the component engineering, and calculate matching 
between images correctly. The preliminary knowledge about an object is unnecessary 
entirely. Count of matching between images is calculated in each resolution, while 
progressing the hierarchy of resolution. The hierarchy of resolution is followed from 
coarse level in order to minute level in that case. A parameter required for count is 
completely set automatically by the dynamic count similar to human being's vision 
system. It is not necessary to specify the corresponding points between images with a 
help. 

[0042] This premise technique is applicable to generation of the smooth dynamic 
image from completely automatic morphing, an object recognition, 
stereophotogrammetry, volume rendering, and few frames etc., for example. When 
using for morphing, the given image can be transformed automatically. When using for 
volume rendering, the in-between image between cross sections can be 
reconstructed correctly. It is the same, even when the configuration of a long distance 
and a cross section is large and the distance between cross sections changes. 
[0043] [1.2] The multiplex resolution singular point filter concerning the hierarchy 



prem.se technique of a singular point filter can save the brightness and location of 
each singular point which are moreover included in an image, dropping the resolution 
of an ,mage. Width of face of an image is set to N, and height is set to M here. Below 
since it is easy, it is assumed that it is N=M=2n (n is the natural number). Moreover [0 
and Section N] **R is described to be I. The pixel of the image in (i,j) is described to 
be p (i, j) (i, 

[0044] The hierarchy of multiplex resolution is introduced here. The hierarchized 
image group is generated by the multiplex resolution filter. A multiplex resolution filter 
generates another image with resolution lower than the image of even if it performs 
two-d.mensional retrieval to the image of a basis, it detects the singular point and it 
extracts ^detected singular point. Size of each image in the m-th level is set to 
2mx2m (0 <-m<=n) here. A singular point filter builds recursively four kinds of new 
hierarchy images as follows towards falling from n. 
[0045] 
[Equation 1] 



(5S1) 

However, it is here and is [Equation 2]. 
^K 0 ) _ „(».!) _ (n,2) (n,3) 



It carries out. These four images are henceforth called a subimage (subimage) If 
m,nx<=t<=x + 1 and maxx<=t<=x + 1 are described to be alpha and beta, respectively a 
subimage can be described as follows, respectively 
[0046] 

P(m, 0) =a.pha(x) a.pha(y) P (1 m+ 0) P ( m . 1) - =alpha(x) beta(y) p(1 m+ „ p(m 
=beta(x) alpha(y) p (1 m + 2) 

PCm, 3) =beta(x) beta (y) p (1 m+ 3 ), i.e.. these, is considered to be a thing like the 
tensor product of alpha and beta. The subimage supports the singular point 
respectively. A singular point filter detects the singular point for every block which 
cons,sts of 2x2 pixels about the image of a basis so that clearly from these formulas 



It searches for a point with the maximum pixel value or the minimum pixel value about 
two directions, i.e., the length, and the side of each block in that case. As a pixel value, 
although brightness is adopted with a premise technique, various numeric values 
about an image are employable. While the pixel from which the pixel which serves as 
the maximum pixel value about both two directions serves as the minimum pixel value 
about both the maximum point and two directions serves as the maximum pixel value 
about one side of the minimum point and two directions, the pixel which serves as the 
minimum pixel value about another side is detected as the saddle point. 
[0047] A singular point filter drops the resolution of an image by representing the 
image (here 4 pixels) of the block with the image (here 1 pixel) of the singular point 
detected inside each block. If it carries out from a theoretical viewpoint of the singular 
point, alpha(x) alpha (y) saves the minimum point, beta(x) beta (y) saves the maximum 
point and alpha(x) beta (y) and beta (x) alpha (y) saves the saddle point. 
[0048] First, singular point filtering is separately performed to the starting point 
(source) image and terminal point (destination) image which should take matching, and 
a series of image groups, i.e., starting point hierarchy image, and terminal point 
hierarchy images are generated, respectively. A starting point hierarchy image and 
four kinds of terminal point hierarchy images are generated at a time corresponding to 
the class of singular point, respectively. 

[0049] Then, matching of a starting point hierarchy image and a terminal point 
hierarchy image can be taken in a series of resolution level, and it is ********. 
Matching of the minimum point is first taken using p (m, 0). Next, based on the result, 
matching of the saddle point is taken using p (m, 1), and matching of other saddle 
points is taken using p (m, 2). And finally p (m, 3) is used and matching of the maximum 
point is taken. 

[0050] Drawing 1 (c) and drawing 1 (d) show the subimage p (5 0) of drawing 1 (a) and 
drawing 1 (b), respectively. Similarly, as for drawing 1 (e) and drawing 1 (f), in p (5 1), 
drawing 1 (g), and drawing 1 (h), p (5 2), drawing 1 (i), and drawing 1 0) show p (5 3), 
respectively. According to the subimage, matching of the description part of an image 
becomes easy as these drawings show. An eye becomes clear by p (5 0) first. It is 
because an eye is the minimum point of brightness in a face. According to p (5 1), 
opening becomes clear. Opening is because brightness is low in a longitudinal direction. 
According to p (5 2), the vertical line of the both sides of a neck becomes clear. The 
brightest point of a lug or a cheek becomes clear by p (5 3) at the last. It is because 
these are the maximum points of brightness. 

[0051] Since the description of an image can be extracted according to the singular 
point filter, the photographic subject reflected in a camera is discriminable by 
comparing the description of some objects beforehand recorded as the description of 
the image photoed with the camera. 

[0052] [1.3] Write the pixels of the location (i, j) of the count starting point image of 



the map between images to be p (n), and (i, j), and, similarly q (n), and (k, I) describe the 
pixel of the location (k, I) of a terminal point image. It considers as i, j, k, and 1**1. The 
energy (after-mentioned) of the map between images is defined. This energy is 
decided by the difference of the brightness of the pixel of a starting point image, and 
the brightness of the pixel to which a terminal point image corresponds, and 
smoothness of a map. Map f(m, 0):p(m, 0) ->q (m, 0) between p (m, 0) which has the 
minimum energy in the beginning, and q (m, 0) is calculated. Based on f (m, 0), the map 
f (m, 1) between p (m, 1) with the threshold energy and q (m, 1) is calculated. This 
procedure continues until count of the map f (m, 3) between p (m, 3) and q (m, 3) is 
completed. Each map f (m, i) (i= 0, 1 and 2, — ) will be called a submap. For the 
convenience of count of f (m, i), the sequence of i can be rearranged like a degree 
type. A reason to be rearranged is mentioned later. 



It is sigma(i) ** {0, 1, 2, 3} here. 

[0054] [1.3.1] When expressing matching between a bijection starting point image and 
a terminal point image by map, the map should fulfill bijection conditions among both 
images. It is because there are no superiority or inferiority on a concept in both 
images and a mutual pixel should be connected by surjection and the monomorphism. 
However, the map which should be built here unlike the usual case is the digital 
version of bijection. A pixel is specified by the lattice point with a premise technique. 
[0055] The map to a terminal point secondary image (subimage prepared about the 
terminal point image) from a starting point secondary image (subimage prepared about 
the starting point image) is expressed by f(m, s):I/2 n-mxI/2 n-m->I/2 n-mxI/2 n-m 
(s= 0, 1, — ). Here, f(m, s) (i,j) = (k, I) means that p (m, s) (i,j) of a starting point image 
is mapped by q (m, s) (k, I) of a terminal point image. Since it is easy, when f(i, j) = (k, I) 
is realized, Pixel q (k, I) is described to be qf (i, j). 

[0056] Like the pixel (lattice point) treated with a premise technique, when data are 
discrete, the definition of bijection is important. Here, a definition is given as follows 
(all of i, i\ j, j', and k and I consider as an integer). Each square field, [Equation 4] which 
are first written by R in the flat surface of a starting point image 



[0053] 
[Equation 3] 




(^3) 



(5*4) 



******** (i= 0, — , 2m-1, j= 0, — , 2m-1). The direction of each side (edge) of R is 
defined as follows here. 



[0057] 
[Equation 5] 



P(iJ) P(»>W)' P(<+lJ)P(i+U+l)' P(i+U+l)P(<J+l) allC1 P(M+l)P(*rf) 
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This square must be mapped by Map f by the quadrilateral in a terminal point image 
plane. The quadrilateral shown by f (m, s) (R), [Equation 6] 



It is necessary to fulfill ** and the following bijection conditions. 
[0058] 1 . The edge of quadrilateral f (m, s) (R) does not cross mutually. 

2. The direction of the edge of f (m, s) (R) is equal to them of R (in the case of aVawmg 
2 clockwise rotation). 

3. Allow a contraction map (RITORA cushion: retractions) as relaxation conditions. 
[0059] Unless some relaxation conditions are established, the map which fulfills 
bijection conditions completely is because there is only a unit map. Here, as for 0 (m, 
s) (R), i.e., f, the die length of one edge of f (m, s) (R) may become a triangle. However, 
don't become a graphic form with which area is set to 0, i.e., one point, and one 
segment. Although drawing 2 (A) and drawing 2 (D) fulfill bijection conditions when 
drawing 2 (R) is the quadrilateral of a basis, drawing 2 (B), drawing 2 (C), and drawing 2 
(E) do not fill. 

[0060] In an actual implementation, the following conditions may be imposed further 
that it should guarantee easily that a map is surjection. That is, in each pixel on the 
boundary of a starting point image, the pixel which occupies the same location in a 
terminal point image ****. That is, it is f(i, j) = G. j) (however, on four lines of i= 0, 
i=2m-1,j= 0, andj=2m-1). This condition is also called "addition conditions" below. 
[0061] [1.3.2] Define the energy of the cost map f about the brightness of the energy 
[1.3.2.1] pixel of a map. It is the purpose to look for the map to which energy becomes 
min. Energy is mainly decided by the difference of the brightness of the pixel of a 
starting point image, and the brightness of the pixel of the terminal point image 
corresponding to it. That is, the energy C (m, s) in the point (i, j) of Map f (m, s) (i, j) 
becomes settled by the degree type. 
[0062] 
[Equation 7] 



^ = |V(p^)-V(^)| 



(5$ 7) 



Here, V (p (m, s) (i, j)) and V (q(m, s) f (i, j)) are the brightness of Pixel p (m, s) (i, j) 



q(m, s) f (i,j), respectively. The total energy C of f (m, s) is one valuation plan by which 
matching is evaluated, and the sum total of C (m, s) (i, j) shown below can define it. 
[0063] 
[Equation 8] 

cf" } = E E (sea) 

[1.3.2.2] In order to obtain the cost smooth map about the location of the pixel for a 
smooth map, introduce another energy Df about a map. This energy is decided by the 
location of p (m, s) (i,j) and q(m, s) f (i f j) regardless of the brightness of a pixel (i= 0, 
— , 2m-1 , j= 0, — , 2m-1 ). The energy D (m, s) of the map f (m f s) in a point (i, j) (i, j) is 
defined by the degree type. 
[0064] 
[Equation 9] 



However, the multiplier parameters eta are the zero or more real numbers, and are 
[Equation 10]. 



[Equation 1 1] 

(aid 



It carries out. It is here and is [Equation 12]. 
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It comes out, and it is and f (i\ j') decides on 0 to i'<0 and j'<0. E0 — and (i, j) it is 
decided by distance of f (i, j). It prevents ****(ing) E0 to the pixel which the pixel left 
too much. However, E0 is replaced with behind another energy function. E1 
guarantees the smoothness of a map. E1 expresses the distance between the 
variation rates and the variation rates of an adjacent point of p (i, j). Based on the 
above consideration, the energy Df which is another valuation plan by which matching 
is evaluated becomes settled in a degree type. 
[0065] 



[Equation 13] 
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[1.3.2.3] The comprehensive valuation plan concerning integration of the gross energy 
of a gross energy map of a map, i.e., two or more valuation plans, is defined by 
lambdaCCm, s) f+D(m, s) f. The multiplier parameters lambda are the zero or more real 
numbers here. The purpose is detecting the condition a comprehensive valuation 
Plans taking extremal value, i.e., finding out the map which gives the threshold energy 
shown by the degree type. 
[0066] 

[Equation 14] 

In the case of lambda= 0 and eta= 0, it should be cautious of a map turning into a unit 
map (that is, it becomes f(m, s) (i, j) = (i, j) to all i= 0, -, 2m-1 and j= 0, -, 2m-1). 
Since this premise technique estimates the case of lambda= 0 and eta= 0 first like the 
after-mentioned, a map can be gradually transformed from a unit map. If the location 
of lambda of a comprehensive valuation plan was changed temporarily and it was 
defined as C(m, s) f+lambdaD(m, s) f, the pixels which in the case of lambda= 0 and 
eta- 0 a comprehensive valuation plan is set only to C(m, s) f, and originally do not 
have relation in any way are matched only by saying [ that brightness is near ] and 
they become what has a meaningless map. Even if it transforms the map based on 
such a meaningless map, semantics is not made at all. For this reason, it is at the 
initiation time of evaluation of a unit map, and is considered in how to give a multiplier 
parameter so that it may be chosen as the best map. 

[0067] The difference and smoothness of brightness of a pixel are taken into 
consrderation like [ an optical flow ] this premise technique. However, an optical flow 
cannot be used for conversion of an image. It is for taking only a local motion of an 
object mto consideration. Global correspondence relation is detectable by using the 
singular point filter concerning a premise technique. 

[0068] [1.3.3] Give the decision threshold energy of the map by installation of 
multiplex resolution, and ask for the map fmin which satisfies bijection conditions 
using the hierarchy of multiplex resolution. In each resolution level, the map between a 
starting point secondary image and a terminal point secondary image is calculated. It 
starts from the most significant (coarsest level) of the hierarchy of resolution, and the 
map of each resolution level is determined, taking the map of other level into 
consideration. The number of the candidates of the map in each level is restricted by 



using the map of coarser level more highly that is,. More specifically on the occasion 
of the decision of the map in a certain level, the map called for in level coarser [ one ] 
than it is imposed as a kind of constraint. 
[0069] First, [Equation 1 5] 

(*,/)-<[*].[*]) (5 * 15) 

******** — it comes suddenly and p (m-1, s) G'.j') and q (m-1, s) O'.j') will be called 
parent of p (m, s) (i, j) and q (m, s) (i, j), respectively, [x] is the maximum integer which 
does not exceed x. Moreover, p (m, s) (i, j) and q (m, s) (i, j) are called child of p (m-1. 
s) (i\ j*) and q (m-1 , s) (i\ j'), respectively. Function parent (i, j) is defined by the degree 
type. 
[0070] 

[Equation 16] 

parent^ J) = a^U{}) 

It is determined by finding what the map f (m, s) between p (m, s) (i, j) and q (m, s) (k, 
I) performed energy count, and became min. By using f (m-1, s) (m= 1, 2, — , n), the 
value of f(m, s) (i, j) = (k, I) is determined as follows. First, q (m, s) (k, I) imposes the 
conditions that it must be in the interior of the following quadrilateral, and narrows 
down what has high actuality among the maps which fulfill bijection conditions. 
[0071] 

[Equation 17] 

(5S1 7) 



However, it is here and is [Equation 18]. 

fl < m ">(i,j) = /^-^{parentiij)) + ^-^Hparentfcj) + (1,1))) 

(SC18) 

It comes out. In this way, the defined quadrilateral is made to call it the inheritance 
(inherited) quadrilateral of Following p (m, s) (i, j). It asks for the pixel which makes 
energy min in the interior of an inheritance quadrilateral. 

[0072] Drawing 3 shows the above procedure, said — drawing — setting — the 
starting point — an image — A — B — C — D — a pixel — the — m - one — level 
— setting — respectively — a terminal point — an image A ' B C 

****(ing) — having . Pixel p (m, s) (i, j) must be ****(ed) to pixel q(m, s) 



f (m) which exists in the interior of inheritance quadrilateral A'B'C'D' and (i j) The 
mediation to the map of the m-th level from a map of the m-1st level is made by the 
above consideration. 

[0073] The energy E0 defined previously is transposed to a degree type, in order to 

calculate the submap f in the m-th level (m, 0) 

[0074] 

[Equation 19] 

^«-H/ ( ^,J*)-fl W («-.»l| a (5JC19) 

Moreover, a degree type is used in order to calculate the submap f (m, s). 
[0075] 

[Equation 20] 

= - /<~^(*,i)|| 3 (i < ,) 

(3:2 o) 

In this way, the map which maintains the energy of all submaps at a low value is 
obta.ned. It is related within the same level by the formula 20 so that the similarity of 
submaps may become [ the submap corresponding to the different singular point ] 
high. The formula 19 shows distance with the location of the point that (i, j) at the time 

llZ rTl n 3 ^ ' S) PiXd ° f m ~ 1St ' eVel Sh ° uld be P^ed. 

L0076] The follow.ng measures are taken when the pixel which fulfills byection 

cond.tions does not exist in the interior of inheritance quadrilateral A'B'C'D' 

temporarily. First, the pixel whose distance from the boundary line of A'B'C'D' is L (it 

-s L- 1 ,n the beginning) is investigated. Among those, if that from which energy 

becomes min fulfills b.jection conditions, this will be chosen as a value of f (m s) (i j) 

L .s enlarged until such a point is discovered or L reaches L(m) max of the upper limit' 

L (m) max ,s immobilization to each level m. When such a point is not discovered at all 
a map to hi h the 3rd condition rf . & ^ ^ . 

of he quadrilateral of a conversion place becomes zero is also accepted, and f (m, s) 
0.J) « determmed. When the point of still fulfilling conditions is not found, the 1st and 
->nd conditions of bijection are removed next. 

[0077] Avoiding that a map is influenced by the details of an image, the approximation 
using multiplex resolution is indispensable in order to determine the global 
correspondence relation between images. If approximation by multiplex resolution is 
not used, ,t ,s impossible to find out the correspondence relation between pixels with a 
far -distance. In that case, the size of an image must be limited to a very small thing 
and can treat only the small image of change. Furthermore, correspondence relation 
between such pixels is made hard to find it, in order to usually require smoothness of 
a map. The energy of the map to a pixel with distance from a pixel is because it is high 



According to the approximation using multiplex resolution, the suitable 
correspondence relation between such pixels can be found out. Those distance is 
because it is small in the upper level (coarse level) of the hierarchy of resolution. 
[0078] [1.4] There is difficulty [ the main faults of the matching technique of 
automatic decision existing of the optimal PAREMETA value ] of one PAREMETA 
adjustment. When the most, it is very difficult for adjustment of a parameter to be 
performed by the help activity and to choose the optimal value. According to the 
approach concerning a premise technique, an automatic decision of the optimal 
parameter value can be made completely. 

[0079] The system concerning a premise technique contains two PAREMETA, and 
lambda and eta. Speaking directly, lambda's being the weight of the difference of the 
brightness of a pixel and eta's showing the rigidity of a map. Initial value is 0, it fixes to 
eta= 0 first and the value of these parameters makes lambda increase from 0 gradually. 
When making the value of a comprehensive valuation plan (formula 14) into min 
moreover, enlarging the value of lambda, generally the value of C(m, s) f about each 
****** becomes small. This means that two images must match more fundamentally. 
However, if lambda exceeds an optimum value, the following phenomena will occur. 
[0080] 1. The pixels which should not correspond essentially are accidentally matched 
only by saying [ that brightness is near ]. 

2. Consequently, the correspondence relation of pixels becomes amusing and a map 
begins to collapse. 

[0081] 3. Consequently, in a formula 14, D(m, s) f tends to increase rapidly. 
4. Consequently, since the value of a formula 14 tends to increase rapidly, f (m, s) 
changes so that the rapid increment in D(m, s) f may be controlled, and, as a result, 
C(m, s) f increases. Therefore, maintaining the condition of saying that the minimum 
value is taken making lambda increase, C(m, s) f detects the threshold changed to an 
increment from reduction, and a formula 14 makes the lambda the optimum value in 
eta= 0. Next, eta is increased little by little, the behavior of C(m, s) f is inspected, and 
an automatic decision of eta is made by the below-mentioned approach, lambda is 
also decided corresponding to the eta. 

[0082] This approach resembles actuation of the focal device human being's vision 
system. In human being's vision system, matching of the image of right-and-left both 
eyes is taken, moving one eye. The eye is fixed when an object can recognize clearly. 
[0083] [1.4.1] It is increased from 0 by the dynamic determination lambda of lambda by 
predetermined unit width of face, and a submap is evaluated whenever the value of 
lambda changes. Gross energy is defined by lambdaC(m, s) f+D(m, s) f like a formula 14. 
D(m, s) f of a formula 9 expresses smoothness, and, in a unit map, becomes min 
theoretically, and E0 and E1 increase it, so that a map is distorted. Since E1 is an 
integer, the minimum unit width of face of D(m, s) f is 1. For this reason, if change 
(decrement) of present lambdaC (m, s) (i, j) is not one or more, gross energy cannot be 



reduced by changing a map. Because, since D(m, s) f increases one or more with 
change of a map, gross energy is for not decreasing unless lambdaC (m, s) (i, j) 
decreases or more by one. 

[0084] With the basis of this condition, and the increment in lambda, when normal, it is 
shown that C (m, s) (i, j) decreases. The histogram of C (m, s) (i, j) is described to be h 
(I), h (I) is a number which is the pixel whose energy C (m, s) (i, j) is 12. Since 
Iambdal2>=1 is realized, the case of 12= 1 -/lambda is considered. It is [Equation 21] 
when lambda carries out minute amount change from lambda 1 to lambda 2. 

A - ,1 m - £ h m ' ~ £ h(l) ^ = t 



(S21) 

A pixels come out of and shown are [Equation 22]. 

* (5£22) 



C^+) _ (2 _ C {m,,) _ i 



It changes [ rather than ] to a stable condition with ** energy. Here, temporarily, if all 
of the energy of these pixels become zero, it approximates. For this formula, the value 
of C(m, s) f is [Equation 23]. 

ao J ~ ~X (S23) 

Carrying out **** change is shown, consequently it is [Equation 24]. 
dG { P' a) = h(l) 

dX ~ A 5 / 2 (SC2 4) 

It ******. h(|) > Since it is 0, C(m, s) f usually decreases. However, when lambda tends 
to exceed an optimum value, an above-mentioned phenomenon, i.e., the increment in 
C(m, s) f, occurs. The optimum value of lambda is determined by detecting this 
phenomenon. 

[0085] In addition, it is [Equation 25] when making H (h> 0) and k into a constant. 
*<P-S*-S5i U2 5) 

It will be [Equation 26] if it assumes. 

~ dX A 5 / 2 +*/2 (^2 6). 



**********. It is [Equation 27] if it is k!=-3 at this time. 

f (3/2 + k/2)X3/2+k/2 



It becomes. This is the general formula of C(m, s) f (C is a constant). 

[0086] In case the optimum value of lambda is detected, insurance may be seen 

further and the number of the pixels which break bijection conditions may be 

inspected. In case the map of each pixel is determined here, the probability to break 

bijection conditions is assumed to be pO. In this case, [Equation 28] 

dA _ h[l) 

0X~Un <«2 8) 



Since it is ******( ing ), the number of the pjxe|s whjch brgak 

increases at the rate of a degree type. 
[0087] 

[Equation 29] 

(it 2 9) 

Therefore, [Equation 30] 

PoHl) (S30) 

It is ******. [Equation 31] when assuming h(l) =Hlk temporarily 

It becomes ******. However, if lambda exceeds an optimum value, the upper value will 
.ncr ease quickly. This phenomenon can be detected, it can inspect whether a 
B0lambda3/2 + k/2/2m value exceeds outlying-observation BOthres, and the optimum 
value of lambda can be determined. The rate of increase B1 of a pixel which breaks 
the 3rd condition of bijection is checked by similarly inspecting whether a 
B1lambda3/2+k/2/2m value exceeds outlying-observation Blthres. The reason for 
-ntroducing factor 2m is mentioned later. This system is not sensitive to these two 
thresholds. By observation of energy C(m, s) f, these thresholds can be used in order 
to detect too much distortion of the map which it failed to detect. 
[0088] In addition, in the experiment, when calculating the submap f (m, s), supposing 



lambda exceeded 0.1, count of f (m, s) was stopped and shifted to count of f (m, s+1). 
At the time of lambda> 0.1, it is because [ in the brightness 255 level of a pixel ] the 
difference in "3" influenced count of a submap only, and it is because it was difficult 
to obtain a right result at the time of lambda> 0.1 . 
[0089] [1 .4.2] Histogram h (I) 

It does not depend for inspection of C(m, s) f on histogram h (I). Effect can be 
received in h (I) in the case of inspection of bijection and its 3rd condition. When it 
actually (lambda, C(m, s) f) plots, k is usually in the one neighborhood. In the 
experiment, B0lambda2 and B1lambda2 were inspected using k= 1. With [ the true 
value of k ] one [ less than ], B0lambda2 and B1lambda2 do not become a constant, 
but they increase gradually according to factor lambda (1-k) / 2. If h (I) is a constant, 
factors are lambda1/2, for example. However, such a difference is absorbable by 
setting up threshold BOthres correctly. 

[0090] A core assumes a starting point image to be (xO, yO), and the circular object of 
a radius r like a degree type here. 
[Equation 32] 

„ _ f 2a c ( v /(i-^o) I + (i-jft») a ) W{i-^r + (j- yo y< r ) 

~ \ 0 {otherwise) 

(it 3 2) 

On the other hand, a terminal point image presupposes that a core (x1, y1) and a 
radius are the objects of r like a degree type. 
[Equation 33] 

** 1 o (otherwise) 

(333) 

c (x) presupposes that it is the form of c(x) =xk here. A core (xO, yO) and (x1 , y1 ) when 
sufficiently far, histogram h (I) becomes the form of a degree type. 
[Equation 34] 

Woe* {k*0) (sC34) 

An image shows an object with the clear boundary line embedded for the background 
at the time of k= 1. This object becomes bright as it is dark in a core and it goes to a 
perimeter. An image expresses an object with an ambiguous boundary line at the time 
of k=-1. This object becomes dark as it is the brightest in a core and it goes to a 
perimeter. Even if it thinks that there is a general object in the middle of these two 
types of object, generality is not very lost. Therefore, k can cover the case where it is 
the most as -1<=k<=1, and it is secured that a formula 27 is generally a decreasing 
function. 



[0091] In addition, as shown in a formula 34, it should be cautious of r being influenced 
by the resolution of an image, i.e., r being proportional to 2m. For this reason, factor 
2m was introduced in [1.4.1]. 

[0092] [1.4.3] Make an automatic decision of the dynamic determination parameter 
eta of eta by the same approach. It is first referred to as eta= 0, and final map f (n) and 
Energy C (n) f in the finest resolution are calculated. Continue, only a certain value 
deltaeta makes eta increase, and last map f (n) and Energy C (n) f in the again finest 
resolution are recalculated. This process is continued until an optimum value can be 
found, eta shows the rigidity of a map. It is because it is the weight of a degree type. 
[0093] 

[Equation 35] 



(j13 5) 



When eta is 0, D(n) f will be determined regardless of the last submap, the present 
submap will deform elastically, and it will be distorted too much. On the other hand, as 
for D(n) f, eta is decided by the last submap nearly completely at the very big time of 
a value. At this time, a submap has very high rigidity and a pixel is projected on the 
same location. Consequently, a map turns into a unit map. When the value of eta 
increases gradually from 0, C(n) f decreases gradually like the after-mentioned. 
However, energy begins to increase as it is shown in drawing 4 , when the value of eta 
exceeds an optimum value. The X-axis of this drawing is eta and a Y-axis is Cf. 
[0094] The value of optimal eta which makes C(n) f min by this approach can be 
acquired. However, as a result of various elements' influencing count compared with 
the case of lambda, C(n) f changes with fluctuation small. In eta, it is because all 
submaps are recalculated but as a submap is recalculated once, whenever an input 
carries out minute amount change of the case of lambda. For this reason, it cannot 
judge immediately whether the value of obtained C(n) f is min. If the candidate of the 
minimum value is found, it is necessary to look for the true minimum value by setting 
up the still finer section. 

[0095] [1.5] In case the correspondence relation between super sampling pixels is 
determined, in order to increase a degree of freedom, the range of f (m, s) is extensible 
to RxR (R is the set of the real number). In this case, the brightness of the pixel of a 
terminal point image is interpolated and they are a nonintegral point and [Equation 36]. 



(m, s) with the brightness which can be boiled and set is offered. That is, a super 



sampling is performed. By experiment, for f (m, s), it is allowed and it is [Equation 37] 
to take an integer and a half-integral value. 



) (5*3 7) 



,i) + (0.5,0.5). 



**, [Equation 38] 



(338) 



Be alike was given. 

[0096] [1.6] When the normalization starting point image and terminal point image of 
brightness of each image contain an extremely different object, if the brightness of the 
original pixel remains as it is to count of a map, it is hard to use for it. [ of a pixel ] 
Since the difference of brightness is large, energy C(m, s) f about brightness becomes 
large too much, right evaluation carries out, and it is for ******. 
[0097] For example, the case where matching of people's face and the face of a cat is 
taken is considered. The face of a cat is covered with hair and the very bright pixel 
and the very dark pixel are mixed. In this case, in order to calculate the submap 
between two faces, a subimage is normalized first. That is, the brightness of the 
darkest pixel is set as 0, the brightest it is set as 255, and it asks for the brightness of 
other pixels by linear interpolation. 

[0098] [1.7] Use how count advances to a linear according to the scan of an 
implementation starting point image inductive. The value of f (m, s) is determined 
about pixel [ of the left end on introduction and No. 1 ] (i, j) = (0 0). Next, f (m, s) (i, j) 
value each is determined, increasing i every [ 1 ]. When the value of i reaches the 
width of face of an image, the value of j is increased one and i is returned to 0. 
Henceforth, f (m, s) (i, j) is determined with the scan of a starting point image. If 
correspondence of a pixel is decided about all points, one map f (m, s) will be decided. 
[0099] If corresponding points qf (i, j) are decided about certain p (i, j), the 
corresponding points qf (i, j+1) of p (i, j+1) will be decided next. Under the present 
circumstances, the location of qf is restricted by the location of qf (i,j) in order 

to fulfill bijection conditions. Therefore, in the point that corresponding points are 
decided previously, in this system, a priority becomes high. If the condition that 
priority is always (0 0) given most continues, an excessive deviation will join the last 
map called for. With this premise technique, in order to avoid this condition, f (m, s) is 
decided by the following approaches. 

[0100] When it is 0 first (second mod 4), it decides making (0, 0) into a start point and 
increasing i and j gradually. When (second mod 4) is 1, the right end point of the top 
line is made into a start point, and i is decided, making reduction and j increase. When 
(second mod 4) is 2, the right end point of the lowest line is made into a start point, 



and it decides, decreasing i and j. When (smod 4) is 3, the left end point of the lowest 
line is made into a start point, and i is decided, decreasing an increment and j. Since 
the concept s of a submap, i.e., a parameter, did not exist in the n-th level with the 
finest resolution, even if it was s= 0 and s= 2, two directions were calculated 
continuously. 

[0101] In the actual implementation, the value of f (m, s) (i, j) (m= 0, — , n) which fulfills 
bijection conditions as much as possible out of a candidate (k, I) was chosen by giving 
a penalty to the candidate who breaks bijection conditions, phi is hung on the energy 
D of the candidate who breaks the 3rd condition (k, I), and, on the other hand, psi is 
hung on the candidate who breaks the 1st or 2nd condition. phi= 2 and psi= 100000 
were used this time. 

[0102] The following tests were performed when determining =f (m, s) (i, j) as a 
procedure actual for the check of the above-mentioned bijection conditions (k, I). 
That is, it confirms whether z component of the outer product of a degree type 
becomes zero or more to each lattice point (k, I) contained in the inheritance 
quadrilateral of f (m, s) (i,j). 
[0103] 

[Equation 39] 



However, it is here and is [Equation 40]. 

x — 

[Equation 41] 



(341) 



Come out and it is (a vector is made into a three-dimensions vector here, and the 
z-axis is defined in a rectangular right-handed coordinate system). If W is negative, it 
will be made whether a penalty is given and is made and not to choose by hanging psi 
on D (m, s) (k, I) about the candidate. 

[0104] Drawing 5 (a) and drawing 5 (b) show the reason for inspecting this condition. 
The candidate to whom drawing 5 (a) does not have a penalty, and drawing 5 (b) 
express a candidate with a penalty, respectively. In case the map f (m, s) to a 



contiguity pixel Q. j+1) (i. j+1) is determined, if z component of W is negative, the pixel 
when sat. S fies b.jeotion conditions on a starting point image plane does not exist 
Because, q (m, s) (k. I) is for exceeding the boundary line of the adjoining quadrilateral. 
L0105J [1.7.1] In the sequence implementation of a submap, when the number of 
resolut,on level was even, sigma(O) =3, sigmad) =2, sigma(2) =1, sigma(3) =0 and 
s.gma(4) =3 were used using sigma(O) =0, sigmad) =1. sigma(2) =2, sigma(3) =3 and 
s.gma(4) =0 at the time of odd number. By this, the submap was shuffled moderately 
In add.tion, originally a submap is four kinds and s is either 0-3. However, processing 
wh.ch is equivalent to s= 4 in fact was performed. The reason is mentioned later 
[0106] [1.8] After the map between a interpolation count starting point image and a 
terminal point image is determined, the brightness which is the pixel which 
corresponds and suits is interpolated. Try linear interpolation was used in the 
expenment. It is assumed that square P (i, j) p(i+1 , j) p(i , p in a starting 

pent ,mage plane is projected on quadrilateral qf(i,j) qfCM.j) qf (i , j+1 ) qf on a termina| 
pent >mage plane (i+1, j+1). Since it is easy, distance between images is set to 1 The 
Pixel r (x y, t) of the middle image whose distance from a starting point image plane is 
t (0<=t<=1) (0 <=x<=N -1, 0 <=y<=M -1) is called for in the following ways. It asks for 
^location (however, x, y, t**R) of Pixel r (x y, t) by the degree type first. 

[Equation 42] 

(*, y ) = (l-«fa)(l-*)(i-0(*',i) + (l-.fc)(i-j y )</(;,j) 

+ dx(l - dy)(l - t)(i + 1 , 7 ) + dx(l - dy)t f(i + I , ;) 
+ (1 - dx)dy{l - j + I) + (l _ dx)dytf(i,j + I) 
+ dxdy[l~t)(i + l,j+l)+dxdyif{i + l,j + i) 

(5£4 2 ) 

The brightness of the pixel in r (x y, t) is continuously determined using the following 
formula. 

[0108] 

[Equation 43] 

V{r{ X ,y,i)) = a-dxXl-dyXl-tjVip^ + il-dxXl-dy^Viqf^) 

+ dx(l - dy)(l - i)V(p [i+1J) ) + dx(l - dy)tV(q f{i+lJ) ) 

+ (1 - dx)dy{\ - t)V(pttffi)) + (1 - dx)dytV{q f{i>H1) ) 

+ dxdy(l - 0V(p (t+u+1J ) + dxd y tV{q J(i+lJ+l) ) 



(^43) 



dx and dy are parameters and change from 0 to 1 here. 

[0109] [1.9] The decision of a map in case a constraint does not exist at all until now 



[ map ] when imposing a constraint was described. However, when correspondence 
relation is beforehand specified between the pixels of the specification of a starting 
point image and a terminal point image, a map can be determined after making this into 
a constraint. 

[0110] By the rough map which moves the specific pixel of a starting point image to 
the specific pixel of a terminal point image first, a fundamental idea transforms a 
starting point image roughly, and calculates Map f correctly after an appropriate time. 
[01 1 1] It opts for the rough map which projects the specific pixel of a starting point 
image on the specific pixel of a terminal point image, and projects other pixels of a 
starting point image on a suitable location first. That is, the pixel near a specific pixel 
is the map which is projected near the location where the specific pixel is projected. 
The rough map of the m-th level is described to be F (m) here. 

[01 12] It opts for the rough map F in the following ways. First, a map is specified about 
some pixels. They are the pixel of ns individual, and [Equation 44] about a starting 
point image. 



U4 4) 



The following values are decided when specified. 
[Equation 45] 

^ W (Wo) = (Wo), 
^ (n) (Wo) = (*i,2x),..., 



(it 4. 50 

The amount of displacement of other pixels of a starting point image is an average 
called for by making weighting the variation rate of p (ih, jh) (h= 0, — ns-1). That is, 
Pixel p (i, j) is projected on the following pixels of a terminal point image 
[0113] 

[Equation 46] 

2»i— wi 

(5S4 6 ) 



However, it is here and is [Equation 47], 



total weight(i,j) 



7) 



[Equation 48] 



total weighi(ij) = £ - j A 



w ,m- .,,„ (aJC48) 

It carries out. 

[01 14] It continues, and the energy D of the map f ( m , .) ft j) is changed so that the 
iZTnm ' " HaVe f6Wer C ° rreCtly ' ° ^ S) 0. j) is 

(5^4 9) 

It comes out. However, [Equation 50] 

4rf ii^^j) - / (m ' s, (»,i)ii 2 < Li^j 

^ l ll^(M-)-/M(i,j)|P, otWw" 

(S50) 

It comes out, and it is and is referred to as kappa and rho> = 0. f is completely 
detained as the last according to the automatic ca.cu.ation process of the 
above-mentioned map. 



those distance is [Equation 51] 

(St 5 1) 



When t is less than. ,t should be cautious of E2 ( m , s) (I. j) being sot to 0. As ,on g as f 
fa. s) (, j) is Cose each to F W. and (i, j) enough, the reason defined such is because 
he wan s to decide the value automatical.v. as it settles in a suitab.e iocation in a 
term™, pent image. It is automatic* ma „ped so that it is not necessary to specify 
exact correspondence reiation as a detail and a starting point image may catch a 
terminal point image for this reason. 

C0t1 8] [2] Explain the flow of processing by each component engineering of concrete 
recede t ,, „ a flow whjoh shows ^ e* 

proc dure. As shown ,„ this drawing, processing which used the multiplex resolution 
singular point Alter first is performed (SO. and matching cf a starting point image and 
a terminal pom, image is taken continuously (S2). Howeye, S2 may process image 
recognition etc. based on the description of the image obtained by SI rather than is 



indispensable. 

[0117] Dj^wing_7 is a flow chart which shows the detail of S1 of drawing 6 . Here it is 
premised on taking matching of a starting point image and a terminal point image by S2 
Therefore, first, with a singular point filter, a starting point image is hierarchized (S10) 
and a series of starting point hierarchy images are obtained. A terminal point image is 
continuously hierarchized by the same approach (S1 1). and a series of terminal point 
h.erarchy images are obtained. However, the sequence of S10 and S11 is arbitrary 
and can also generate a starting point hierarchy image and a terminal point hierarchy 
image in parallel. 

[0118] Drawing 8 is a flow chart which shows the detail of S10 of drawing 7 Size of 
the starting point image of a basis is set to 2nx2n. Since a starting point hierarchy 
image » made sequentially from the one where resolution is finer, the parameter m 
wh.ch shows the resolution level set as the object of processing is set to n (S100) It 
continues. The images p (m, 0), p (m, 1), and p (m, 2) of the m-th level, The singular 
point ,s detected using a singular point filter from p (m, 3) (S101), and the images p (1 
m- 0), p (1 m- 1), p (1 m - 2 ), and p (1 m - 3 ) of the m-1st level are generated 
respectively (S102). Here, since it is m=n, it is p(m, 0) =p( m . 1) = p ( m , 2 ) =p(m , 3) =p (n) ' 
and four kinds of subimages are generated from one starting point image 
[0119] Drawing 9 shows the correspondence relation between some images of the 
m-th level, and some images of the m-1st level. The numeric value of this drawing 
shows the brightness of each pixel. In p ( m , s ) of this drawing symbo|izing four jmages 
of p (m, 0)-p (m, 3) and generating p (1 m- 0), p ( m , s) thinks that it is p (m 0) Under 
the regulation shown by [1.2], p (1 m - 0) about the block as which brightness was filled 
m for example, in this drawing "3" and p (1 m- 1) replace "8" and p (1 m- 2) among 4 
Pixels contained there by one pixel which acquired "10" for "6" and p (1 m - 3) 
respectively, and acquired this block, respectively. Therefore, the size of the subimage 
of the m-1st level is set to 2m-1x2m-1. 

[0120] The decrement of the m is carried out continuously (SI 03 of drawing 8 ) and it 
ohecks that m is not negative (S104), it returns to S101, and then the subimage with 
ooarse resolution is generated. As a result of this repeat processing, when m= 0 i e 
the subimage of the 0th level, is generated, S10 is completed. The size of' the 
subimage of the 0th level is 1x1. 

[0121] Drawing 10 has illustrated the starting point hierarchy image generated by S10 
about the case of n= 3. Only the first starting point image is common to four 
sequences, and the subimage is henceforth generated independently according to the 
olass of smgular point, respectively. In addition, processing of drawing 8 is common 
also to S11 of drawing 7 , and a terminal point hierarchy image is also generated 
through the same procedure. Processing by S1 of drawing 6 is completed above 
[0122] With a premise technique, in order to progress to S2 of drawing 6 . matching 
evaluation is prepared. Drawing 1 1 shows the procedure. As shown in this drawing two 



or more valuation plans are set up first (S30). energy C(m, s) f about the pixel 
introduced by [1.3.2.1], and energy D(m, s) f about the smoothness of the map 
introduced by [1.3.2.2] - then, it is. Next, these valuation plans are unified and a 
comprehensive valuation plan is stood (S31). gross energy lambdaC(m, s) f+D(m, s) f 
introduced by [1.3.2.3] — then — if eta which it is and was introduced by [1.3.2.2] is 
used sigmasigma (lambdaCCm, s) (i, j)+etaE0(m, s) (i, j)+E1 (i, j) (m, s)) (formula 52) 
It becomes. However, total calculates by 0, 1 — , and 2m-1 about i and j, respectively. 
Preparation of the matching evaluation by the above is completed. 
[0123] Drawing 12 is a flow chart which shows the detail of S2 of drawing 6 . As [1] 
described, matching of a starting point hierarchy image and a terminal point hierarchy 
image is mutually taken by the images of the same resolution level. In order to take 
global matching between images good, resolution calculates matching sequentially 
from coarse level. Since the starting point hierarchy image and the terminal point 
hierarchy image are generated using a singular point filter, the location and brightness 
of the singular point are clearly saved also on level with coarse resolution, and the 
result of global matching becomes what was very excellent compared with the former. 
[0124] Like drawing 12 , 0 and the level parameter m are first set as 0 for the 
multiplier parameter eta (S20). It asks for four kinds of submaps (s= 0, 1, 2, 3) (m, s) f 
which continue, calculate matching between each of four subimages of the m-th level 
in four subimages of the m-th level in a starting point hierarchy image, and terminal 
point hierarchy images, and fulfill bisection conditions, respectively, and make energy 
min (S21). Bijection conditions are inspected using the inheritance quadrilateral stated 
by [1.3.3]. Under the present circumstances, as shown in formulas 17 and 18, since 
the submap in the m-th level is restrained by them of the m-1st level, sequential use 
of the matching in level with more coarse resolution is carried out. This is 
perpendicular reference between different level. In addition, although it is m= 0 now 
and there is no level coarser than it, this exceptional processing is later mentioned by 
drawing 13 . 

[0125] On the other hand, horizontal reference in the same level is also performed 
like the formula 20 of [1 .3.3] - f (m, 3) decides that f (m, 2) is similar to f (m, 1 ), and f 
(m, 1) is similar to f (m, 0) at f (m, 2), respectively. If the reason is included in the 
starting point image with the them same from the first, and the terminal point image at 
all even if the class of singular point is different, it is because the situation that 
submaps completely differ is unnatural. Energy becomes small, so that submaps are 
near, as shown in a formula 20, and it considers that matching is good. 
[0126] In addition, since there is no submap which can be referred to on the level 
same about f (m, 0) which should be decided first, as shown in a formula 19, level 
coarse [ one ] is referred to. However, in the experiment, after being found to f (m, 3), 
the procedure of updating f (m, 0) once by making this into a constraint was taken. It is 
equal to this substituting s= 4 for a formula 20, and setting f (m, 4) to new f (m, 0). It is 



for avoiding the inclination for the degree of association of f (m, 0) and f (m, 3) to 
become low too much, and the experimental result became fitness more by this 
measure. In addition to this measure, in the experiment the shuffle of the submap 
shown in [1.7.1] was also performed. It is the meaning which keeps close the degree of 
association of the submaps it is originally decided for every class of singular point that 
this will also be. Moreover, in order to avoid the deviation depending on the start point 
of processing, the point of changing the location of a start point according to the value 
of s is as [1.7] having described. 

[0127] Drawing 13 is drawing showing signs that a submap is determined in the 0th 
level. Since each ****** merely consists of one pixel, it is altogether decided on the 
0th level automatically that four submaps f (0 s) will be unit maps. Drawing 14 is 
drawing showing signs that a submap is determined in the 1st level. A subimage is 
constituted from 4 pixels by the 1st level, respectively. These 4 pixels are shown by 
the continuous line in this drawing. The following procedures are completed when 
looking for the corresponding points of the point x of p (1 s) in q (1 s) now. 
[01 28] 1 . Search for the upper left point a of Point x, the upper right point b, the lower 
left point c, and the lower right point d in the resolution of the 1st level. 

2. Look for the pixel to which one point a-d belongs in coarse level, i.e., the 0th level. 
In the case of drawing 14 , point a~d belongs to pixel A-D, respectively. However, pixel 
A-C is an imagination pixel which originally does not exist. 

3. Plot corresponding-points A' of pixel A-D which is the 0th level and has already 
been found - D' in q (1 s). Pixel A' - C shall be an imagination pixel, and shall be in the 
respectively same location as pixel A-C. 

4. Consider that corresponding-points a' of the point a in Pixel A is in pixel A', and plot 
point a'. At this time, it is assumed that the location which point a' occupies in pixel A' 
is the same as the location (lower right in this case) which Point a occupies in Pixel A. 
Corresponding-points b' - d' is plotted by the same approach as 5.4, and an 
inheritance quadrilateral is made from point a' - d'. 

6. Look for corresponding-points x' of Point x so that energy may become min in an 
inheritance quadrilateral. As a candidate of corresponding-points x\ the core of a pixel 
may limit to what is contained in an inheritance quadrilateral. In the case of drawing 
14 , all of four pixels become a candidate. 

[0129] It is the decision procedure of the corresponding points of the point x with the 
above. Same processing is performed about all other points, and it opts for a submap. 
On with a level [ 2nd / more than ] level, since it is thought that an inheritance 
quadrilateral loses its shape gradually, the situation that spacing of pixel A' - D' is 
vacant as shown in drawing 3 occurs. 

[0130] In this way, if four submaps of a certain m-th level are decided, m will be 
incremented (S22 of drawing 12 ), and it will confirm that m is not over n (S23), and will 
return to S21 . It asks for the submap of the level of resolution gradually fine whenever 



it returns to S21 hereafter, and when it finally returns to S21, map [ of the n-th level ] 
(n) ,s decided. Since this map becomes settled about eta= 0, it writes it as f (n) and 
(,eta- 0;. 

[0131] Only deltaeta shifts eta in order to ask also for the map about next different 
eta and the zero clear of the m is carried out (S24). It checks that new eta is not over 
predetermined retrieval cancel value etamax (S25), and S21 is asked for map f (n) and 
eta=deltaeta) about return and this eta. This processing is repeated and it asks for f 
(n) (eta=ideltaeta) (i= 0, 1, -) by S21. When eta exceeds etamax, it progresses to S26 
and the optimal eta=eta opt is determined by the below-mentioned approach, and,' 
finally f ( n ) and (eta=eta opt) are set to map f (n). 

[0132] Drawing is a flow chart which shows the detail of S21 of drawing With 
th,s flow chart, the submap in the m-th level is decided about certain fixed eta. In case 
■t opts for a submap, with a premise technique, optimal lambda is decided 
independently for every submap. 

S M draW1 ' ng ' Z6r ° C ' ear ° f S ^ d ,3mbda iS Carried out first 

S210). Next ,t asks for the submap f Cm, s) which makes energy min about lambda at 

hat time Ot reaches and is about eta to dark) (S21 1), and this is written to be f (m s) 

(.ambda= 0). Only deltalambda shifts .ambda in order to ask a.so for the map about 

d,ffcrent lambda, and it checks that new lambda is not over predetermined retrieval 

cancel value lambdamax (S213), and S211 is asked far f On. s) C,ambda = ide,ta,ambda) 

i Zi retUm SUDSeqUent repeat Processings. When lambda exceeds 

ambdamax^t progresses to S214, and the optimal lambda=.ambda opt is determined, 
and, finally f (m, s) (lambda=lambda opt) is considered as Map f (m s) (S214) 
[01 34] Next, the zero dear of lambda is carried out in order to ask for other submaps 
m the same level, and s is incremented (S215). It checks that s is not over 4 (S216) 
and returns to S21 1 . If set to s= 4, f (m, 0) will be updated like **** using f (m , 3 ), and 
the decision of the submap in the level is ended. 

[01 35] Dr^ingje is drawing showing the behavior of energy C(m, s) f corresponding 
to f On. s) Oambda=ide,ta.ambda) 0= 0, 1, ~) calle d far while changing lambda about 
certain m and s. If lambda increases, C(m, s) f will usually decrease, as [1 .4] described 
However, ,f lambda exceeds an optimum value, C(m, s) f will start to increase. So with 
th,s premise technique, lambda in case C(m, s) f takes the minima, value is decided to 
be ,ambdaopt. What is necessary is just to note the first minimum point, in order for 
the map to already have collapsed at the time and not to make semantics, even if C(m 
s) f becomes small again in the range of lambda>lambda opt, as shown in this drawing' 
lambdaopt is decided independently for every submap, and, final.y becomes settled 
one also about f (n). 

[0136] On the other hand, dj^wing_l7 is drawing showing the behavior of Energy C (n) 
f corresponding to f (n) (eta=ideltaeta) 0= 0, 1 , -) calle d for while changing eta. If eta 
-ncreases also here, C<SUP>(n) f will usually decrease, but C(n) f will start to increase 



if eta exceeds an optimum value. Then, eta in case C(n) f takes the minimal value is 
decided to be etaopt. Drawing 17 may consider drawing which expanded near the zero 
of the axis of abscissa of drawing 4 . If etaopt is decided, terminal decision of the f (n) 
can be carried out. 

[0137] As mentioned above, according to this premise technique, various merits are 
obtained. Since it is not necessary to detect an edge probably, the technical problem 
of the edge detection type conventional technique is cancelable. Moreover, the 
transcendental knowledge over the object contained in an image is also unnecessary, 
and automatic detection of corresponding points realizes it. According to the singular 
point filter, the brightness and location of the singular point can be maintained also on 
level with coarse resolution, and it is very advantageous to object recognition, a 
feature extraction, and image matching. Consequently, construction of the image 
processing system which mitigates a help activity sharply is attained. 
[0138] In addition, the following deformation techniques are also considered about this 
premise technique. 

(1) With the premise technique, when taking matching between a starting point 
hierarchy image and a terminal point hierarchy image, the automatic decision of a 
parameter was made, but this approach can be used for the whole when taking 
matching between [ instead of / between hierarchy images ] the usual images of two 
sheets. 

[0139] For example, between the images of two sheets, make two, the energy EO 
about the difference of the brightness of a pixel, and the energy E1 about a 
location-gap of a pixel, into a valuation plan, and let these linear combination 
Etot=alpha E0+E1 be a comprehensive valuation plan. An automatic decision of the 
alpha is made paying attention to near the extremal value of this comprehensive 
valuation plan. That is, it asks for a map to which Etot becomes min about various 
alpha, alpha in case E1 takes the minimal value about alpha among those maps is 
decided to be an optimal parameter. Finally it is considered that the map 
corresponding to the parameter is the optimal matching between both images. 
[0140] What there are various approaches in a setup of a valuation plan besides this, 
for example, takes such a big value like 1 / E1, and 1/E2 that an evaluation result is 
good may be adopted. A comprehensive valuation plan does not necessarily need to 
be linear combination, either, and should just choose suitably the function of the n-th 
power sums (n= 2, 1/2, -1. -2, etc.), a polynomial, and arbitration etc. 
[0141] In the case of two (eta and lambda), any, such as a case beyond it, are 
sufficient also as a parameter only for alpha like a premise technique. When [ one / 
every ] a parameter is three or more, it is made to change and decides. 
[0142] (2) With this premise technique, after deciding a map that the value of a 
comprehensive valuation plan becomes min, the point that C(m, s) f which is one 
valuation plan which constitutes a comprehensive valuation plan became the minimum 



was detected, and the parameter was determined. However, it is effective even if it 
decides a parameter that the minimum value of a comprehensive valuation plan only 
becomes min depending on a situation instead of such two-step time processing. 
alphaEO+betaEI is made into a comprehensive valuation plan in that case, the 
constraint which becomes alpha+beta =1 may be established and measures, such as 
treating each valuation plan equally, may be taken. The energy of the essence of the 
automatic decision of a parameter is because it is in the point of deciding the 
parameter to become min. 

[0143] (3) The premise technique generated four kinds of subimages about four kinds 
of singular points on each resolution level, however — naturally — 4 kinds of inside 1 
— 2 or 3 kinds may be used alternatively. For example, if it is in the condition that only 
one bright point exists in an image, suitable effectiveness should be acquired even if it 
generates a hierarchy image only by f (m, 3) about the maximum point. In that case, 
since a submap which is different on the same level becomes unnecessary, it is 
effective in the computational complexity about s becoming less. 
[0144] (4) With this premise technique, when one level progressed with the singular 
point filter, the pixel was set to one fourth. For example, a pixel will be set to one ninth, 
if the configuration which considers as 1 block by 3x3, and looks for the singular point 
in it is also possible and one level progresses in that case. 

[0145] (5) When a starting point image and a terminal point image are colors, change 
them into monochrome image first and calculate a map. The color picture of the 
starting point is changed using the map called for as a result. As the other approach, a 
submap may be calculated about each component of RGB. 

[0146] The gestalt of operation using the premise technique beyond [the image 
effectiveness or the gestalt of the operation about image interpolation] is explained. 
Although the gestalt 1 of operation mentions the thing more near application after the 
thing more near a principle, and the gestalt 2 of operation, it is not necessary to draw 
a clear boundary line to them, and one of the functions of the arbitration of the gestalt 
of operation and the function of the arbitration of the gestalt of other operations may 
be combined with them. 

[0147] Gestalt 1 drawing 18 of operation shows the 1st image 11 and the 2nd image 12 
which are a key frame, and some pixels p1 (x1, y1) and p2 (x2, y2) correspond among 
them. These correspondences are called for with the premise technique. 
[0148] Drawing 19 cuts a mesh on the 1st image 11, and shows the correspondence 
location on the 2nd image 12 of the polygon which constitutes the mesh. The polygon 
R1 now observed on the 1st image 11 was decided by the four lattice points A, B, C, 
and D. This polygon R1 is named an "origin polygon." these — four — a piece — the 
lattice point — A — B — C — D — drawing 18 — having been shown — as 
respectively — the — two — an image — I — two — a top — corresponding a 
point — A — ' — B — ' — C — ' — D — ' — having — these — a point — forming 



- having - a polygon - R - two - "a terminal point polygon" - naming . Although 
an origin polygon is generally a rectangle, generally a terminal point polygon is a 
quadrilateral. Anyway, the gestalt of this operation does not describe the 
correspondence relation between the 1st image 11 and the 2nd image 12 per pixel, but 
describes that correspondence pixel about the lattice point of an origin polygon. The 
description is written in a corresponding-points file. By observing the lattice point, 
capacity of a corresponding-points file can be made very small. 

[0149] A corresponding-points file is used in order to generate the middle image of 
the 1st image 11 and the 2nd image 12. This point can generate the middle image of the 
time location of arbitration by interpolating the location of corresponding points, as 
the premise technique described. Therefore, morphing and the smooth animation 
between two images are generable to it by saving the 1st image 11, the 2nd image 12, 
and a corresponding-points file. For this reason, the compression effectiveness of an 
animation is acquired. 

[0150] Drawing 20 shows how to calculate the correspondence relation about points 
other than the lattice point from a corresponding-points file. Since there is only 
information about the lattice point in a corresponding-points file, it is necessary to 
calculate correspondence information separately about the point inside a polygon. 
Drawing 20 shows correspondence with the triangle ABC which hits the lower half of 
the origin polygon R1 of drawing 19 , and triangle A'B'C' which hits the lower half of 
the terminal point polygon R2 similarly. Suppose that it was in the location where the 
point Q inside triangle ABC by the side of an origin polygon divides Segment AC 
interiorly to t: (1-t), and divides interiorly between the internally dividing point and 
Point B to s: (1-s) now. What is necessary is just to think that corresponding-points 
Q' in triangle A'B'C by the side of the terminal point polygon of this point Q is in the 
location which divides segment AC interiorly to t: (1-t), and divides interiorly between 
that internally dividing point and point B' to s: (1-s). Namely, what is necessary is to 
divide an origin polygon into a triangle and just to search for the point inside a terminal 
point polygon in the form of the internal division of the vector about the triangle. If 
vector italic shows, it will be BQ= (1- s ) {(1-t) BA+tBC}. 
coming out — it is — therefore, B'Q'= (1- s ) {(1-t) B'A'+tB'C} 

Though natural, suppose that the same processing is made also about between the 
triangle ACD which hits the upper half of the origin polygon R1, and triangle A'CD' 
which hits the upper half of the terminal point polygon R2 similarly. 
[0151] Drawing 21 , shows the above procedure. The matching result about the lattice 
point taken on the 1st image 11 is first acquired like drawing 19 (S10). What is 
necessary is to perform matching of the pixel unit of a premise technique and just to 
extract the part which hits at the lattice point out of that result at this time. However, 
the matching result about the lattice point may be specified others, a matching 
technique, for example, an optical flow, and based on block matching, without using a 



premise technique. 

[0152] It continues and a terminal point polygon is defined on the 2nd image 12 like the 
right of drawing 19 (312). Since a corresponding-points file is above generable the 
."formation for identifying the 1st image 11 and the 2nd image 12 is incorporated and 
outputted to this file (SI 4). Two images and a corresponding-points file are held at the 
records device or medium of arbitration, or are put on a direct network or a 
broadcast wave, and should just be transmitted. 

[0153] Drawing 22 shows the procedure which generates a middle image using a 
corresponding-points file. First, the 1st image 11 and the 2nd image 12 are read (S20) 
and a corresponding-points file is read (S22). It continues and the correspondence 
re at.cn between the point in an origin polygon and the point in a terminal point 
Polygon is computed by the approach of drawing 20 (S24). At this time the 
correspondence relation about all the pixels in an image is acquirable. Therefore If the 
coordinate and color of a point which correspond each other are divided interiorly by 
u: (1-u) as the premise technique described, the middle image in the location which 
d.v.des interiorly between the 1st image 11 and the 2nd image 12 by :u in time (1-u) is 
generable (S26). In addition, not only interpolation interpolation but extrapolation 
interpolation may be carried out. 

[0154] Dj^wingJ* shows the configuration of the image effectiveness equipment 10 
which performs the above processing. The image input section 12 in which this 
equ,pment 10 acquires the 1st image 11 and the 2nd image 12 from external storage an 
external photography camera, etc., The matching processor 14 which performs 
matching count to those images with the technique of a premise technique and others 
The corresponding-points file attaching part 16 which stores the 
corresponding-points file F generated by it, The middle image generation section 18 
which generates a middle image from the 1st image 11 and the 2nd image 12, and the 
display 20 displayed as an image near the animation of while carrying out timing 
adjustment of the 1st image II, the 2nd image 12, and the middle image are included 
Moreover, the communications department 22 sends out the 1st image 11, the 2nd 
image 12, and the corresponding-points file F to the transmission infrastructure of a 
network and others according to the request from the outside. In addition, the mesh 
information which shows the magnitude of a mesh, the location of the lattice point etc 
is inputted into the matching processor 14. 

[0155] By the above configuration, the 1st image 11 and the 2nd image 12 which were 
inputted into the image input section 12 are sent to the matching processor 14 The 
matching processor 14 performs matching count of a pixel unit among those images 
The matching processor 14 generates the corresponding-points file F based on mesh 
information, and outputs it to the corresponding-points file attaching part 1 6 
[0156] the middle image generation section 18 - a user - it responds for asking or 
the corresponding-points file F is read by other factors, and a middle image is 



generated. This middle image is sent to a display 20, timing of an image output is 
performed there, and an animation or a morphing image is displayed. This equipment 
10 may be in the remote terminal side of another configuration, that terminal receives 
the 1st image 11, the 2nd image 12, and comparatively light data called the 
corresponding-points file F in that case, and the middle image generation section 18 
and a display 20 can reproduce an animation independently as this actuation also 
shows. 

[0157] The communications department 22 is a configuration for it, and it assumes 
that the remote terminal has already waited at the network point here. That is, the 
communications department 22 puts and sends out the 1st image 11, the 2nd image 12, 
and the corresponding-points file F to a network or a broadcast wave, and the display 
of an animation is performed by the remote terminal side. Of course, a remote terminal 
is good for the purpose of not a display but storage. In addition, this equipment inputs 
the 1st image 11, the 2nd image 12, and those corresponding-points files through the 
communications department 22 from the exteriors, such as a network, passes these 
to the middle image generation section 18, carries out interpolation count, and also 
has the application which generates a middle image. The path P of the data for it is 
described by drawing 23 . 

[0158] When experimented about the contents of processing of the gestalt 1 of 
operation, very good morphing or the animation compression effectiveness was 
acquired by adopting about 256x256 magnitude and setting the lattice point as every 
direction 10 - every dozens of pixel extent as the 1st and 2nd image. The magnitude 
of a corresponding-points file is about 10 K bytes from several K, and it has checked 
that the height of image quality and the smallness of the amount of data could be 
realized. 

[0159] The image effectiveness equipment realized with the gestalt 1 of gestalt 2 
implementation of operation can be used for the goods presentation in electronic 
commerce. This equipment (henceforth "goods presentation equipment") of the 
gestalt 2 of operation uses as the 1st image 11 and the 2nd image 12 the image of two 
sheets which approaches among the photographs of the goods photoed from some 
include angles, and suits, and goods are shown to a user by interpolating between 
them smoothly. For example, a rotation image smooth 360 degrees is obtained by 
carrying out sequential interpolation of the photograph taken from the surroundings of 
goods at intervals of 10 degrees. Conventionally, the smooth rotation image of goods 
is using the technique of the gestalt 1 of operation, although photography was needed 
every 1 or 2 degrees at most, and it has become clear that this include angle is made 
to 10-20 degrees. 

[0160] Unlike the gestalt 1 of operation, goods presentation equipment uses the 
corresponding-points file F generated beforehand. The photograph of goods is 
because it can prepare before presentation. If only difference with the configuration of 



drawing 23 is shown, the image input section 12 will acquire the corresponding-points 
file F other than the 1st image 11 and the 2nd image 12. These are inputted into the 
middle image generation section 18, and a middle image is generated. A middle image 
may be displayed by the display 20, or may be sent out through the communications 
department 22 to the transmission infrastructure of a network and others. With the 
gestalt of this operation, the matching processor 14 and the corresponding-points file 
attaching part 16 are unnecessary. In addition, such a configuration is effective also in 
the gestalt of other operations. 

[0161] In addition to the gestalt 1 of operation, goods presentation equipment offers 
the goods presentation function in electronic commerce. When this function is the 
above-mentioned goods rotation function, goods may be rotated according to the 
directions inputted through GUI from the user. The approach of such directions is 
learned [ that it is various and ] for the field of CG, and uses such a technique here. 
[0162] The middle image which interpolated the goods image in the two directions and 
was obtained as another example of a function may be displayed. For example, it can 
interpolate not only to a longitudinal direction but to a lengthwise direction by 
photoing goods at intervals in addition to taking a photograph at intervals also in a 
lengthwise direction in a longitudinal direction. This function includes a lower process. 
(1) The image pair B which consists of the 3rd image of a process (2) which acquires 
the corresponding-points information A between the images of these [ the image pair 
A which consists of the 1st image and the 2nd image, and ] two sheets, and the 4th 
image The physical relationship of the shaft A which becomes settled in time or 
spatially between the images of two sheets of the process (3) image pair A which 
acquire the corresponding-points information B between the images of these two 
sheets, and the shaft B which becomes settled in time or spatially between the images 
of two sheets of the image pair B, The process which generates a middle image with 
interpolation using the corresponding-points information A and the 
corresponding-points information B. 

[0163] In (3), biaxial interpolation (bilinear interpolation) may be performed using Shaft 
A and Shaft B. As an example, it considers as the image pair A obtained from two 
views p1 (0 0) and p2 (0,100), and considers as the image pair B obtained from two 
another views p3 (100 0) and p4 (100,100). The straight line to which the straight line 
which connects points p1 and p2 connects Shaft A and points p3 and p4 hits Shaft B. 
[0164] When obtaining the image seen from view p- (50 50) as a middle image, the 
frame from a view (0 50) is first generated based on the corresponding-points 
information A between the image pairs A. Next, another frame from a view (100 50) is 
generated based on the corresponding-points information B between the image pairs 
B. It continues, and interpolates on these two frames, namely, divides interiorly by 1:1 
in this case, and a desired intermediate frame is generated. What is necessary is here, 
just to set the image pair A and the image pair B that Shaft A and Shaft B do not 



come on the same straight line generally, in order to interpolate both directions in 
every direction. 

[0165] In addition, although Shaft A and Shaft B become settled spatially between the 
images of two sheets in this example, respectively, there is also another example 
which becomes settled in time. For example, two images obtained from one view P to 
time _ of _ day t=t o andtl are made into the image pair A, and two images obtained from 
another view Q to time-of-day t=t 0 andtl are made into the image pair B. in this case, 
the image pair A — setting (P, tO) — the straight line which connects the point 
defined and the point defined by (P, t1) — Shaft A — becoming — the same — the 
image pair B — setting (Q, tO) — the straight line which connects the point defined 
and the point defined by (Q, t1) serves as Shaft B. Therefore, what is necessary is just 
to interpolate these, respectively, after generating the image from a point (P+Q) (/2, 
(t0+t1)/2), then the in-between image of two shafts for a middle image. 
[01 66] It is in charge of generation of the gestalt 3 middle image of operation, and the 
function about the image effectiveness may be offered. Although the gestalt 1 of 
operation described the image effectiveness as generalities, the image effectiveness 
here may be considered to be a near application more concretely or professionally. It 
is [ following ] the example of a function. 

[0167] Out of three or more images, two adjoining images are selected as the 1st 
image and the 2nd image, and those middle images are generated and displayed. It 
continues, another adjoining image is used as the 1st image and the 2nd image, and a 
middle image is generated in order henceforth. For example, when there are images S, 
T, and U with which views differ little by little, a series of images can be continuously 
displayed by making the middle image of Images S and T first, and then making the 
middle image of Images T and U. That is, a panoptic image will be obtained, if between 
many discrete view images is interpolated one after another and a middle image is 
generated. 

[0168] Although it is the same approach as this, the element of time amount can also 
be taken in. For example, if two or more discrete images are caught with the image to 
which the view was moved with time amount and order is displayed for those middle 
images later on, the so-called walk-through image will be obtained. 
[0169] Another function displays the middle image which interpolated the image set as 
the object of processing in the two directions, and was obtained. 2 shaft interpolation 
realizes this approach as the gestalt 2 of operation also described it. Thereby, the 
panorama image which carries out continuation change is also obtained for example, in 
the two directions. 

[0170] Still more nearly another function is a function which photos a certain object 
with the surroundings little by little, and generates those sequential images. Although 
the goods itself were rotated with the gestalt 2 of operation, fun is in the point which 
displays the image which photoed the object round rather as image effectiveness. 



Although the image which goes around the person who remained in the air is 
generated by the SFX technique on some movies, according to the gestalt 1 of 
operation, such an image is easily generable with fewer photographs. 
[0171] The existing image effectiveness can be increased the efficiency of or 
high-definition-ized with the technique concerning the gestalt of operation besides 
these. The equipment concerning the gestalt of this operation may carry GUI as which 
a user specifies whether which image effectiveness is performed, and may mount the 
function of suitable pretreatment or after treatment in the contents of assignment. 
[0172] For example, when generating a walk-through image, the moving trucking of a 
view may be specified beforehand and a middle image may be displayed in order 
according to it. When interpolating in the two directions, the view moved according to 
GUI, for example, the migration direction of a mouse, is assumed like the gestalt 2 of 
operation, a interpolation image is generated, and a potato is good. If a mouse moves 
to the upper left from the lower right, it assumes that the view also moved to the 
upper left from the lower right, and it should just carry out 2 shaft interpolation. 
[0173] As the gestalt 1 of gestalt 4 implementation of operation also described, this 
invention is fit also for compression of an animation. Since an animation is 
reproducible based on few static images, it is advantageous in case an animation is 
distributed by the Internet etc. For this reason, it is in charge of generation of a middle 
image, and the utility feature about generation of a dynamic image may be offered. 
[0174] As an example of the function, the number of sheets of the middle image which 
should be generated is specified. For example, if the 1st image and the 2nd image are 
photoed with spacing of 1 second from the first, there are usually about 30 frames 
among them. If a user specifies it as "30 middle images" through GUI etc., the same 
thing as the animation of a basis will be obtained as a time scale. If "3000 sheets" is 
specified here, the slow motion image which extended time amount 100 times will be 
obtained. Since it will end with this invention if the step size of interpolation count is 
only changed however large this number of sheets may become, there is no part 
completely difficult for processing. A camera to the extent that 3000 frames can be 
photoed in current and 1 second does not exist, but according to the gestalt of this 
operation, the super slow motion image of the time amount rate of arbitration is 
obtained. 

[01 75] Since gestalt 5 this invention of operation reduces the amount of data and can 
generate an animation, generally its constraint is advantageous also to the application 
to common mobile computing devices to a CPU power, a battery life, and memory 
space. Therefore, generation of a middle image may be performed under the function 
on condition of application to mobile computing devices. 

[0176] As an example of the function, the middle image generated based on one side 
and said correspondence information on the 1st image or the 2nd image may be 
displayed. In that case, there is little capacity of the memory for setting an image 



temporary, and it ends. What is necessary is just to move the image element (for it to 
be made to only represent with a pixel below) of the polygon and others on each pixel 
and the mesh of the 1st image according to correspondence information, when only 
correspondence information and the 1st image generate a middle image. That is, 
although both the location of a pixel and a pixel value, i.e., a color, can usually be 
interpolated for correspondence information, this is simplified to processing of only 
migration of the location of a pixel. 

[0177] As another function, streaming processing of the 1st image and the 
correspondence information may be carried out, and a middle image may be generated. 
As an example, the middle image of t=0-1 is generated and displayed from image [ of 
1 .t=0 ] I (0), and correspondence information. The streaming display of an animation is 
realized by comparatively small memory space by generating and displaying the middle 
image of t=1-2 from image [ of 2.t=1 which throws away image I (0) ] I (1), and 
correspondence information, and repeating processing in which image I (1) is thrown 
away. As for a middle image, in any case, it should exist in a frame buffer only at the 
moment of a display. 

[0178] In the above, this invention was explained based on the gestalt of some 
operations. Each of these functions or processings can be offered in the form of a 
computer program. Moreover, the combination of the arbitration of the above 
processing and recombination are also effective as a mode of this invention. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] The image and drawing 1 (c) which are obtained with drawing 1 (a) by 
drawing 1 (b) giving an equalization filter to two persons' person's face, and drawing 1 
(d) The image, drawing 1 (e), and drawing 1 (f) of p (5 0) which are called for with a 
premise technique about two persons' person's face The image, drawing 1 (g), and 
drawing 1 (h) of p (5 1) which are called for with a premise technique about two 
persons' person's face The image, drawing 1 (i), and drawing 1 (j) of p (5 2) called for 
with a premise technique about two persons' person's face are the photograph of the 
halftone image which displayed on the display the image of p (5 3) called for with a 
premise technique about two persons' person's face, respectively. 
[Drawing 2] Drawing in which drawing 2 (R) shows the quadrilateral of a basis, drawing 
2 (A), drawing 2 (B), drawing 2 (C), drawing 2 (D), and drawing 2 (E) are drawings 
showing an inheritance quadrilateral, respectively. 

[Drawing 3] It is drawing showing the relation between a starting point image and a 
terminal point image, and the relation between the m-th level and the m-1st level 



using an inheritance quadrilateral. 

IBrawin^ It is drawing shewing the Nation betwaan Parameter ata and Energy Of 

r 2tar;r :r nditions 1 - an °- - * - *— 

feawingj] ft is tha flow chart which shews tha wheia premise technics. procedure 
Eawin^T] It ,s tha flew chart which shews tha detail ef S, ef drawing 6 
° raW ' nB "j h iS the flow <= ha * -hews tha detail of S10 of drawing 7 

* iS * aWi " £ oerraspendence relation become images 

of the m-th level, and some images of the m-1 st level 

I«^is drawing showing the starting point hierarchy image generated with 

m«^m Before progressing to S2 of d™™^ , » is drawine showing ^ 
procedure of preparation of matching evaluation 

mrawinaJZ] ,t is tha flow chart which shows the detail of S2 of drawing 6 
EHHtOa >t is drawing showing signs that a submap is determined in the Oth level 
t ,s drawing showing signs that a submap is determined in the ,st leva 
fewmtia It ,s the flow chart which shows the detail of S2T of drawing tP 
mr^a » is drawing showing the behavior of energy c(m, s) fl^** „ , 
m s) dam da=,de,ta,ambda) called for while changing ,ambda about certain f Cm s> 
Bto**12 H , drawing showing the behavior of Energy C (n, f corresponding to f n) 
(eta-,deltaeu) (i= 0, r ,-) called for while changing eta ' 
fertlJfl ! drawing shewing signs that the pixel which it is between the ,st 
image and the 2nd image corresponds 

feM It is drawing showing the correspondence relation between the or*n 

f raW ' n , B 201 ft ' S * a "" ns *«*>• *• Procedure of searching for the point in the 
ermmal pent polygon corresponding to the point in an origin polygon 
ffiaMng^JJ .t is the flow chart which shows the procedure which generates a 
corr. S pond,„g-pointe file with the gestalt 1 of operation 

.t is the flow chart which shows the procedure which generates a middle 
mage based on a corresponding-points file with the gesta.t t of operation 

i ::i b r diaeram ° f tha ima - — — 

[Description of Notations] 

10 The Image Effectiveness Equipment 

1 2 Image Data Input Section 

14 Matching Processor 

16 Corresponding-Points File Attaching Part 
18 Middle Image Generation Section 
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t>(Dm-frt>t>fr%> t*5<3, SUM^fc <£ftMi^©^g|5 

»CDVy^>'^^( C ^§ o £-^ p (5. O) 
fe§o p C5, 



C5- 2) fC^tltft'TO 



wfliojKiSgJb^sst^So mmc, p cs. 3 ) ( Cj;o 
xn^mnm t> wz v >^*t^s${c & § 0 ens «»g © 

[0 0 5 l ] 1#S^7-i';l/^(cj:ti{fiii^©!|f^fi6ffi 

-e t 5 /c 46, 0i * (fa p< 5 r-JiK ■znrmm<DW$kt. 
m.t %> c t ic <t t» , a^^tcf^o fes^fls j&«igij-r s £ 

[0 0 5 2] [ 1 . 3 ] SHtiPEgcD^fgiOftg: 

^UftOfufiCi, j ) CD®^^ p (n) (1 

t»^, (WJ i; < ^Mi^teS (k, 1) cDHIt^q 
Cn) ck. i ) VKMlrz 0 i, j, k, leitt 

S5 0 SWfCS/hOX^^'-^Op Cm. CD i; q 
Cm, CD fS^D^m f Cm. CD ; p Cm. CD -h> q 
Cm, CD ^IfgfJtlSo f Cm. O) icm-l^s ig/jN 

I^M'-^jfOp Cm. 1 ) % q Cm. 1) f^CD^ft 
f < m - D ^fftP^n^c C<D^mt, p Cm. 3) 

tq Cm, 3 5 COfflO^f f Cm. 3) CDmWtf&7? 

IiST'Ko f Cm, O ( j = 0 , 1 , 2 , 

••■) *®mmt«?-Kztic-?% 0 f cm. i) on-sc© 

[0 0 5 3] 
[&3] 



,(m,cr(»')) 



I JITS 



£CT'o (i) <E {0, 1, 2, 3} T-&5„ 
[0054] [1. 3. 1] i£ 1 jtjft 
^SBHIi t ^,£H^£>RB<DV -y ^ V ^7"^^ftT- 

fr^wmTmmznz^z re & ?> 0 l*p 

[0 0 5 5] ^IUiB# (^Bfttco^Tiatf^ftfc 
BJBfe) *^^9JiB« (^!iiftfco^TIStt5.fi/c 

BJlB#) ^\<D^fti±, f Cm. s) ; I/2n-m X I 
/2 n— m->. I /2 n — mX I / 2. n— m ( S = 0, 



(5£3) 

1, •••) lcj;^TgSn«„ iICT\ f 

cm, S ) (ii j) = ( k , i) it. !&Mmm<Dp 

Cm - s) ci. j) A^iSBftOq Cm, s> 
Ck. i) t'5iSni,i:t?:Mt5„ WmoitzHb 
\C. f (i, j) = (k, 1) tfl&QiL-OtZWmq 
Ck. i > £q f ( i, j) ^32xlit"-So 

[0056] mffimT*Wi5mm o^^fc-r' 

Tii«TOJ;9(c^a-r§ (i, i' , j, j' , k, 
[|5t4] 



(^4) 



^r^X-S (i=0, 2 m — 1 , j =0, 2 m — 
1) = CLfR^ia (17^) cD/3|p]*J.XTOck 5 fc 



[0 0 5 7] 
[^5] 



(10) 
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<m,a) (m, 3 )* (m,*) (tn,s) (m.#) > , (m^ 

P(W) P(»+lJ)i P(i+U)P(i+l,J+l)> P(i+lJ+l)P(ij+l) and P(«,i+l)P(«J) 

(5£5) 



Bicmm-ztimfmi&Pifjii^ f cm, S 3 ( R ) [c 

coo58] i. mm&t (m - s5 (R) OX7i^li 

2. f s3 (R) ©X-yi^D^fa&RCD^ft^fC 

fU^ (02©lf£\ B#ff[Hlt>) o 

3 . Sf ftj^fr t L TlU*S^« ( U h 5 * ^> a > : retrac 
tlons) ^rfFfo 

[0059] m*fr(Dmi£ift-itWLtf%i^frgK>, ±m 

5o CCtttf s3 (R) OU^OOX-yyoi 

£#0, t&d? f cm, s) (R) {±Hftj£fC&oT 

t«fcv\ l^u mmtfo tftzxoftmft}, -r%:t>% 

l l *<Dmft\ci3i-oTizrs.e,r£\,\ mz (R) 

^ttOEgfflJg©*^ 0 2 (A) tM2 (D) 
W*ff*»rc-r*\ H2 (B) , B2 (C) , 1212 

(E) fi»S^$%v\ 

[0 0 6 0] StiR^-Y^U^y^-v'a^Tti, ^fiR 



[ft 6] 

(5*6) 

tf±MT*h% c t zmmcum? < < . $ s tc wt©* 
£ tt,^ fe©T-$>So -r&*3-s, f (i, j) = (i, 

j ) (fcfcL 1=0, i = 2 i , j = 0 , j = 2 m 
— 1 CD 4 2t=<D«a_h) T$5 0 CO*ftW r#jp* 

[0 0 6 1 ] [1. 3. 2] 2^t©x*;l/c£- 

[i. 3. 2. i] MgoiewttciMi-rsnxh 

(i, j ) fCfcttSx^yl/^-C Cm, s) (i 

[0 0 6 2] 
[ft 7] 



j 3 



LLt\ V (p Cm 
(m, s ) 



s ) 



Ci , j) ) RCfV (q 
Z> 0 f<Dh-^;K0X^-C Cm. si ^ v>y^ 

[1. 3. 2. 2] i^^^iO/:i60li^I^ 

^&<, p Cm. s) (i j5 ^J;t/q Cm, s) 

f Cl , j) OffiWCctoTStSS (i=0, 2 m 
fcJSU ^><9*-*iiJi0£U:©SHRT*»>, $ 



(5S7) 

cm, s3 (l . 5 ©-gr.H-T^iST t§ 0 

[0 0 6 3] 
[ft 8] 



(x£8) 

-1, j =0, -, 2m-l) „ JS (1, j) tCfetfi. 
^{tf Cm. s3 COX^;!^— D Cm, s3 ( t ^ 

[0 0 6 4] 
[ft9] 



[ft 1 0] 



4z } = \\(^)-f M (iJ)\f 



(39) 



(ss; l 0) 



[in] 



(11) 
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t v =i-l j'=j-i 



||(».y)||«.vS I +F 

T'fetK i' <0fc'J:O c j' <0tc*fLTf (i' , 
j ' ) «0 £&46§ 0 E D « ( i , j ) Rtf f ( i , 

j) osn-pftss, e otiaifs^fesofcfcKnrciii 

i=2 m -V ;=2"' -1 

[1. 3. 2. 3] ^«<D«X*;l,:p- 

s^saaiiAc cm, s > f + D cm, s> f ^ 

On. s) (i. j) = (i, j) £;£5) 0 im<D£ 

t < , A = 0 &t5 rj = 0 (Di§&* 

iif fifi-T * fcft, fc£jg Lt^ < 

Cm - s > f + a d cm, S ) f t^gibfct-rntf, 

A = 0&tfT J = 0O«^fC«^fMB^C Cm. s) f 

#iSv> £ l> a ^frtTWJCS-rJW 5 ft, fe <D 

[0 0 6 7] *-?"rjj3)\s7U— ^^L<DmW&VfmU, 

(•V)-([fl.[fl) 

jb^Diroi:^, p cm-i. S ) ci - . j - > ^ q 

Cm-l. s3 (i . j . •) fc^tHpftp Cm, s3 

ci, j > ^ q Cm - s> ( i . j) Oparenti 



(2tl 1) 

[^1 2] 

U12) 

So 
[0 0 6 5] 
CSStl 3] 



(513) 

[0 0 6 6] 



(«14) 

[0068] [ i . 3 . 3 ] ^mmm&iDmxic «t « 
[0069] 

[115] 

(S15) 

§„ $fcp Cm, s > Cl j -> , q Cm. s) 

c , . j j fc^ft^Fft 

p Cm- 1 . s3 Ci ' . J * 3 - q Cm_ 1 • s) 

Cl -, j - ) Ochi Id tf>fS 0 Klifc parent 



(12) 
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( i , j ) «&5£?5&R£ft£o 
[0 0 7 0] 



P*r e «*(i,j) = ([i],[|]) 



p Cm - s> (i. d Cm - s) ck, o ©IB 
co^fftf Cm. S ) x*;l/4MH**froT*/Nc 
i&ofctO^rSott^C^T^^nSc f <»»• s > 
(i, j) = (k, 1) (Dig.it f Cm - 1 • s > (m = 
1, 2, n) ^fflWCfcfao^ J^T€>«fc5{C 



[816] 



U16) 

[0 0 7 1] 
[S17] 



V«.0(t-l,j-l)y tf ( m .*)(«-lj+l)^( m .*)(»+l,j+l)yj('".')(f+l, > f-i) 



(3C17) 



[» 1 8 ] 



9 {m "Khj) = ^"-^(jwen^i, j)) + fi tn ~ 1 ^) (parental, j) + (1,1))) 



(3C18) 



T-^5o C 5 LT^fcHaa^, WTp Cm 
j) ©*IM (inherited) fSmfctuf&i 



s ) 

Ci. j) "JlfHft unncritea; WiWtfZW-frC £IC? 

[0 0 7 2] i3(i«±Ofm^LT^5„ IWlEltCfe 
V^T, ^i±f|if)1fg!CDA, B, C, DtDmMlt, t8m- 1 U 

^^wcfcv^T-^-n^n^a^oA' , b' , c , 
d ' ^KsnSo iihi^p cm. s> Ci J3 *h 
MraaffjA' b' c d' <D\H%Mc&i±-r'%mmq 



<m - s) f cm) d. j ) 'N^sftfcttntfae 

[0 0 7 3] ^HrjggU^x^^-E 0 {±, Stall"* 
;Wc*5tt3BJ¥«f Cm, °) ?rlt»-r§fc:46fc, 

[0 0 7 4] 
[»1 9] 



tfij'^tf Cm. s) ^MUt^rciblclt^^m 



(SCI 9) 



[0 0 7 5] 
G&2 0] 



= ll/ (m,e, ('.i) - /^'(i.i)!! 2 (i < 0 



c o LTT^rcDmnw<D^ji^~^m>igicu-o^ 
mmm. smm z 5 l © jpftts^is < & & <t ? tc^i- 

Cm. S ) (j, j) Sm- l U^.;KDMM(D— gq 
(i, j) ^K^ns^ffjSOffilti: 

[oo7 6] mmmmBA' b' c d- ©asp 
mztz> 0 $-r, a' b' c d' ©tti^is^p,osggi 

tfL (^46l±L=l) V3b ZMMZM^Zo ^n^>(Dv 

«\ cn*r cm. s> (j, j ) ©ffii: tTas?-r 

©L Cm) ma xfCfiM-r5*-Z?, L%;*ct<LT^ 



0) 

<= L Cm) ma xl^l/^;l/mlc5tLTIS1^T$5 0 

^§^9^¥fitlSi6, f Cm. s) (i_ 

t§ 0 ^nv^i^mrc-r^m-ot)^^^^^ o 
[0077] ^swafg^ffl^saittteti, ^tttfHtt 

&*R^rz-f<ztit^m-e&z>o ^nms, «§©+?- 



(13) 
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[0 0 7 8] [1. 4] S^&^l^-^fficDgijf&t 

[0079] mmmic&&i/7.7-L.i$&rz-3<D>s.\s* 

6 co/^v p< - * ©fflfiSJJBffitf 0TI)D, * -f tj = 0 tc 

l^^S), L^t^-a-fpffis (Si 4) 

[0 0 8 0] 1. **MfS-r^^T'«^^|ii^-H3 L 
*^ J*fc»K*<ifiV> i: t,> 3 JSW-PKo T^tS^tt 5 ft 

•So 

2. SB* Ha L<O^Mffia<*jfrL<fcD, 

-ffttiCfeSo 
[0 0 8 1 ] 3 . ?<D$SS, 5$ 1 4 fCfct^T D 

4 . f^ISS, 5£ 1 4 OfflA^iftfciiftp L J: 3 i: f S 

46, d c.n, s) r (D^m^mim^mnt^^o f 

Cm. s) fttgfcU ^CQ*SJjlC Cm, s) f mmU? 



t^t^o^m^mnL-D-Dc cm, S ) f #jfeMp5 

iiAntCtE DSSSffl^m L, A * rj = 0 tCfetfSg 
i&ffi£:"fSo •D€lZr]%:'PL-3-om j PLTC Cm. s ) 

[0 0 8 2] £(Dj;mi, AHOffili'XfiOMi 

g L % W 5 l^liov <y =f- y tZti 
So *7^±'? hmt-D^fy tmm-C'Z2>t%, .^cog 

^@^$ftSo 

[0083] [1. 4. 1] A 

A B 0 ^SmS£DgiJ^it>ITliiP$ftTV^, A ©ffltfg 
to5J»C»J3?litffPffi£ftS 0 ^1 4<D;T£:<U «gX^. 

;V^-ttAC Cm. s) f+D Cm. S ) f (Cj; 0 T^ 
fS^ftSo it9<DD Cm. s) f (ijfe,3b>J^-a-rt<D 

tytiHE o feE ! fetii/nLTl/Ko E , ^ftT&Sfr 

D Cm. s) f CD®/jNglJ^(i 1 T&S 0 CCDfc 
46, IJt£<DAC Cm. s) (i j3 (jgj/> a) 
* s 1 W±7»«:^fttf , ¥fi$M{t£-tr S C (C «fc o 

WoTD Cm. s> f fii J^_btein-rSfei6, A 
C Cm. .3 0 . } #j J.;U:M'>L&^|g<3*&x* 
;b^'-fiM?.^^fci6T-feSo 

[0 0 8 4] CKDfcfttDfci:, A <DmMcm\ lE^S: 
m^icc cm. S ) Ci n WUi'}?t&C£%7ji-t. 
C Cm. S ) (i j3 otxh^A^h (1) HIE 
iEfSo h (1) l±x*;l/4?— C Cm. s) {i 

tfi 2 T-^Siii*toiSc-efe§o a i 2 > i ^figoirofc 

46fC, fljfcffl 2= 1/A<0«^*^* 0 AAU 
P. A 2 $T-^/J«ffrSHt, 
[t2 1] 



C^ , ' ) - / 2 = C} m ' J,) - \ 

TtifStc, CftP.cDiii*<73x^.;l/^— WT^T-tfmctS: 

dc im, a) = _A 

dcj m ' 9) h(i) 

A^ir-rSo h (i) >0T-fes*^, ii^c 



(S21) 



m 2 2 ] 



(S22) 

SiljfiffiJLT^So COiCliC Cm. S ) f (D^, 
[ft 2 3] 



(S23) 



[ft 2 4 ] 



(S2 4) 

c™- *5 f (±i'M§„ la -1 \w&mm*mz.& 



(14) 
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ot-?Z>t%, ±j£<Dmms OS DC Cm. S ) f(0 ig 



dX = 



H 



[0 0 8 5] ftfe, H (h>0) RZfk*l£$it + %£ 
[H&2 5] 



[£$2 6] 



(SC2 5) 



(S2 6). 



Cj*"* = C + 



C«t 2 7 ] 



(3/2 + ifc/2)A 3 / 2 +V2 



(^2 7) 



if) o 

[0 0 8 6] AcDift^ffi^^aj-r^Ki $5tC^^M 

p o ^fK£-3~3 0 e£D*§-a\ 
[g?2 8] 



8A h\l) 
OX A s /» 

[0 0 8 7] 

m2 9] 



(5C2 8) 



B 0 = 



C»3 0] 



(SC2 9) 



= 1 



(S3 0) 



(i^i$CT-&3o ISfch (1) =H1 *£{Krr3i;^ 

C»3 1] 

BoXVW-poH (43 1) 



t5„ |Bl«tC, B,A3/2 + k/2/2m(!)f^g 

W lthre s *fflA3frif3fr*fca-rsci:f<:«fc 

s/x-y-Attctie 2o<DBafig(c^T'(i4i/\ ens© 

ISfflti, XiM/^'-C Cm, s) f (DWmT'ltmtii LM 

[0 0 8 8] tttsZ&trCti^ 6?l^fcf Cm, s) ^jfp; 
■T^^ tLA^O. l^lS^fc^f Cm. s) on-|[ 
«±46Tf Cm. s+ ij (DnmiCteftLfco A>0. 
lOit- HiRcD/lf S 2 5 5 W<Jl>tt><Dt>-ffr r 3 J © 
iai/^W^fiROtf-KEtJitJWLrcfcftT***), A>0. 1 
© i: t IE L t ^*g**f# 3 C i: fi H« f£ o 46 -pfc S „ 

[0 0 8 9] [1 . 4. 2] tXh^i^h ( 1 ) 
C Cm, s) f O^litxh^Ah (1) fC#c?¥L 
ttl\ £¥M&Xf ; t<D®3<Dgki ! l<Dtfi£(0^ h (I) 

K&W%&V5&o H^fC (A, C Cm. s) f ) %f 

Wht&b, k irMft 1 ttmc&Zo 'Mm-Cli k = l 
B 0 A 2i:B ! A 2^ifLfc„ <g{CkO*a 

©fiStf i TfcSj-e&ntf, B Q A2i:B,A2 fi^fc4 

t4. h (1) tf£ft-?feftfcf, ^J^.ff7r^^-t±A 

[0 0 9 0] T'MOC* < &£HH»* f^tf ( x 
0 . y 0 ) » *8r <DVW.n*-jri?x.v bT&ztMM 
?Z 0 



[S3 2] 

= i 2 T<V / ( l '- a: o) 2 + (i-S ft> ) J ) (>/(«-*o) 2 +Cj-lfc) a s"r) 

<j£32) 



, «£0iT'i: <(f>L> (x ! , y,) 



(15) 
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m3 3] 



f 2 

mi - { o 



^(^(i-^ + O'-vi) 2 ) 



CCTc (x) lie (x) = x k©}gt-$i§tt§o 

'D> ( x 0 , y 0 ) &zf (x ! , y , ) tf-tfrmi^m^ 

^Xh^Ah (1) {i&aSOJgfcfcS,, 
[ft3 4] 

ft(0«»-z* (Jt^o) 

(S34) 

^fto^^'x ? h^TTK-To C ©;t7"v"x * h^^;^ 
3:2ct5&t/\ LfcAbt, Hi- l ^ k< l £ LT^fg 



(\A«-*l) 2 + (.7-yi) 2 <r) 
(S33) 

[O 0 9 1 ] 5£3 4A^t5^5<J;3fC, r(Ai 

5C tfca*-r^^Tfe§ 0 CCDfc&blC [1. 4. 1] 

[0092] [1. 4. 3] ijOi&Wl*^ 
J] = 0 £ U afcffl*^->«f«Sfcfelt5fii^W33:¥« f 

[0 0 9 3] 
[ft3 5] 



<'; ) = ii/ M (i,»-/ (,n ''- i) (i,j)ii 3 



Ofr^Jjtfcig^i:^ im<D£t<C cn) f(i ^ 
(i rj, YtttiC f T'feSc 

[0 0 9 4] CCDjjmvC Cn) f ^R/jNtc-f§g®/5: 

^^^mmtimmcmmt^m, c c n) f{i/J> 



1 /(>»•*) 



l£$5tf%>W&%:1%-z> f Cm. S ) ^H^^tl^o OSD 

(i,j)+(0.5,0.5)J 



(S3 5) 

So L<Dfti6, t#P>n/£C Cn) f tOfifl^ffi/^-efe^^ 

[0095] [1. 5] x-/^— 
fc, f cm. s) cofii^RxR^t6.jM-r^e:i:^^^ 

im.3 6] 



U3 6) 

cm. s) t*mk&tf¥w&et*tzttiNfF£ti, 

[ft 3 7] 

(5S3 7) 



w<?< ( 5°) + nc„,))/2 



[ft3 8] 



(S3 8 ) 



[0096] [ 1 . 6] <Dmm<Dwm<Dmm\: 



(16) 
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Co o 9 7] «*fcf, AOMfcSofiovy^y**: 

[0 0 9 8] [1. 7] Y^U^^f-S/ay 

(i, j) = (o, o) fcov^Tf cm, s) com^ 

itt%>o i * i -ro^La^esf 
cm, s) ( it j ) ©jja^jj?t5 o i ofifi^a^o 

WK, ^PK^OX^-v >&cf¥^ f Cm. s ) ( i t 

ftSiltf, OfcOCO^flRf Cm. s) tfjfc£5 0 
[0 0 9 9] £3 p Cl> fcO^T2frSj£q 

f c i , j ) tf&sntf, osffc P c t b J + 1) os 

f C i . j + i) *^»5tlSo COIg, q 

f c i . j + D ^ttBtt^iiiW^swrc-rrcfttc, 

Qf ci. j) ©ffifilCckotMKSnSo Lfctfo 
T , ft fcfoS j£ tfft * £ f 5 if C S/ X t- A T ffiftffi 
*W<ft«o Ofafc: (0, 0) ^itM^nsw 



[R4 1] 

D 9 /< m '*)(iJ-l)?(Jb,/) 



n«\ ■fo^atcov^TttD cm, S ) Ck ^ o 

C0104]H5(a).g|5(b)ttC <D2kft*ffiM 
t51fi?:SLT^5 0 05 (a) ti^/l/f^©^ 
Mfrfk 0 5 (b) l4^;l/r--r*^s^?B* ; tn^ f n^ 



Cm, s) £WT©#ffiTi**T^<o 

[0 10 0] (s mod 4) a<0E>J§£\ (0, 

0) «SMfij£4:l, iSt/j *»*fcig^L4#5i*i&T 
^<o (s mod 4) tfl^ m±ff(Dft&$&&* 
gflS&^i: U i j *ig*nS*&#5ifcftT^ 

<o (s mod 4) ^20^§, «TfTO«ffl»j^*M 
*&j5£U i &t/j W>J^We?MT^<o (s 
mod 4) *30^ «TffoaEfl»ji5*MSfijigi: 
U i^igftk j ^a / >?^±^:^?)^a6TV>< 0 

£ s ffitc s =o&tf s = 

2 fife* bT^/cOC0^^JiMWtcIt» L/Co 

[oioi] ii^y7°';^>f-^3>m ^ 

MM (k, 1) Off^6Tfr*B0^****ft*i« 

fc^-f Cm. s) (j, j) ( m = 0 , n) (Dig* 

fiMBcte: 0 ^rSKtSo 0 = 2, tf> = 1 0 0 0 0 0 

[0 10 2] Bfta©^l|i»^O^x-y^(Drc«>te, 

BSG^lKfcLT (k, 1) =f Cm, s) ( it j) % 

cm, S ) ( if j ) ©ffl«8E33a}gfc#$ns*|& : FjS 
(k, 1) fc*fU Honi^z^0W±^5;§ 

[0 10 3] 
[*£3 9] 



(5*3 9) 

C»4 0] 



(S4 0) 



(S41) 

to (i, j + 1 ) fcttTS^flR f cm. S ) 

( i , j + 1 ) SB, WO z «»A^ftT**i»f 

ffibav\ fciffts, q cm, S ) Ck> o ams^r 

[0105] [1. 7. 1] BJ^ftOJIfiff 
^IC&o CO) -0, a (1) = 1 % o (2) =2, o 



(17) 
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(3) =3, a (4) =o*ffll\ ^©i:#«o 

(0) =3, o (1) =2, a (2) = K o (3) = 

0, o (4) =3%m^fc 0 £<D£bT\ W\W^M& 

[0 10 6] [i . 8] *fnsw-ir 



r (>• .n it c t + i , j > q f c i . j + i ) q 

K*U (0< t < 1 ) T-fe^rTSilHtWHiRr (x, 
y, t) (0<x<N-l, 0^ y <M- 1 ) tiUTO 
SnBT*5Ri&£ft3o $fB*r (x, y, t) Ofug 

(fcfcLx, y, t6R) 

[0 10 7] 

HU 2] 



c i . j) P ci + i. p ci. j + n P 

(«._») = (1 - efc)(l - dy)(l - 0(*',i) + (1 - cfa)(l - dy)tf(i,j) 
+ dx(l - dy){l - t)(i + l,j) + dx(l - dy)tf(i + l,j) 
+ (1 - dx)dy(l - 0(i, i + 1) + (1 - dx)dytf{ij + I) 
+ <te<fy( 1 - + 1, j + 1) + dx<fy*/(i + IJ + 1) 



O-^VTr (x, y, 



(xt4 2) 

[0 10 8] 

m 4 3 ] 

VM*. y> *» - (i - - #)(i - t)v( P(l . i) ) + (i - - <fo)<V(<jr, W) ) 

+ dx(l - dy)(l - t)V(p [i+lJ) ) + dx(l - dy)tV{q f(i+itS) ) 
+ (1 - dx)dy(l - t)V(p {u + i} ) + (1 - < fa)dy<V( 9/w+1) ) 



ClclT-d xSt/d y fi^v;* — ^TrfeD, 0*^ 1 ST? 
[0109] [1. 9] ^JlC*#*WLfci:#©^« 

[oiio] s-rs&^iii«©^oiai 



«43) 

[0 111] S-TJ&fefc, te^iB«<D^fl!)Bi3)S*iK^ 

[0 112] *t:^&¥{iF«l^T©BflTi*463 0 * 
[IS 4 4] 

,in,-l) 



HS4 5] 



U44) 
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i r(n) («o,io) = (Ab,/o), 



F W (»n.- 1 ,ir l ,-l) = (fcn.-l,/n.-l) 



^H«©ftSOiii3tS©St4S«x p ( ih. j h) (h 
= 0, -, n s - 1) 0^tt(cM^tt*LT*46P>ti 



(34 5) 

[0 113] 
C«C4 6] 



(346) 



CT\ 



ER 4 8 ] 



C»4 7 3 



^(i,J> 1/ll( V i,J w.f 
y v fofoi weight(t,j) 



total weighi{i J) = * £f - i,j h - j)\\ 2 

K=a 

t-t&o ^f— D Cm, s) 

[0 1 14] F Cm) fcifivH&ff^flfc f #«fc Cm. s) 

^Mv^x^^-^oJ:^:, ?©?®f©i^;i [SSc4 9] 

}("*-*) „» tf( m '') _1_ « R?( m >«) _L - 



C 1 , j 5 



^(iJ) ~ **** + ^^HJ) + ^(i.,) 



(34 7) 



(S48) 



j ) fcggrrs,, lE»n±, d 



CS49) 



DK5 0] 



fM _ f o, if ||f<")(», j) - /<^>(i,i)J 2 < Li^J 

2 <^> ~\ \\FW{i,j) - f( m ^{i,j)\\ 2 , 'otherwise 



[0 115] ClT, f Cm. s) (i,j)^F 

cm) (i.j) ic-t^m^t^, -D^^^tx^mm 
m 5 1 ] 

[ 2 2(£-m) 1 (55 5 1 ) 

Wft-£%>Z>b.%, E 2 cm. S ) (i j;) ^o{c^:i, 

§f Cm. s) (j.j) ^ F Cm) ( it j) IC+fti&^m 



(S50) 

o 

[0116] [2] mim&i&m^m 

[i] ©sg*&ffiic<fc5M3©ffin*a&iiB-rSo a6 

m<D?t<, g-f%>mmmm&m&7 -t nzitm^rm 

SfcfiV (Si) , o^i/->T^iii«!i:^PB^ov>y 
=f-y*fitt% (S2) „ fcf£u s 2ti^M"e«^<> 
s l T?»5»tifcli#(D#^fci:{cH«iK!^if©5!ia 

[0 1 1 7] 07«H16OS KDmM^T^tyti-^-^ 
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ajS7^;b*fc«toT»jSBS«oB»fb*m^ (s l 
0) , H^tt;£|gJllifr&f§£o or3^Tra«<D#ffi 
^ttjSBfl^lSifbfcfT^ (S 1 lK — »(D^pgJl 
Mi£rf#£ 0 fc/cU S10i:Sl 1 ©J»*«ffii:Ta& 

[0 118] H8fiH7<DS 1 OcDPffl^r^^n-^ 
t-ht^5o fe fc^J&^Bt'D^^Xtt 2 n X 2 " 

-^m^rnfC-fcry (S 1 0 0) o OO^tSml/ 

^;\/(DMi% p Cm - 0) , p Cm, i> 

p Cm, 2) s p Cm, 3) & ^g^? 

t^M^ffii (s i o i ) , fnfnsm- i u*^ 

^©BH^p Cm— 1 . O) > p (m~ 1 , 1 ) ^ p 
Cm- 1 . 2) ^ p Cm- 1 . 3) ( S 1 0 

2) o £ cH?tim = n T£3/c#), p Cm, o) = p 

Cm f 1) = p Cm, 2) — p Cm, 3) = p (n) 

[oi 19] H9«2SmU^;l/(0|aHtto— 8154:, gSm- 
Cm, o) _ p cm. 3) 0 4O0Hfi#ftItf 3fcO 

T\ p Cm-1. O) ££^3^tC&, P 
Cm. s) ttp Cm, O) T36Sfc%A5 0 [1. 2] 

"P^Lfeffl0iJte.J:t), p cm-i, o) tt^ij^(f|ii|g|-p 

Z I (AC Cm, s) c { ^ . , 

• s > Cl , j) ) (352) 

[o 1 23] 01 2«gi 60s 2<Dmm^mtyti—^- 

+ -h"P**o [l] ?a^ftcTi:<, te^JBPH^ 

[0 1 2 4] 0 1 2(DCTfc <, $^£i5^^-^ rj£: 
0, — ^m^OfcK^fS (S2 0) 0 o 

-^vt, %$gmmm^(D%sn\ i^;i/o 4 oom'Jbhij t 



T3J , p Cm- 1 , 1 > « T8J , p 

Cm- 1 , 2) £ T6J , p Cm- 1 , 3) ^ T 1 0J 

OgiJiIj{tO^Xte2™-- 1 x 2 m ~ 1 \zr&%> 0 
[0 12 0] OoVtm^'J^yh L (0 8 OS 1 
0 3), mA^caoT^a^Cfc^BIEL (S 1 0 

4) , s i o i icm^T^mcfflm&vm^mmm*^ 
•r^o mo u^i/oiijH^o^^rxtt i x i T-fcSo 

[0 1 2 1] 01 0{±S 1 OfCct^T^fiRSnfcftfijSB 
SlM»*n = 3 0ti^cov>TM^LT^3 0 IfflOfe 

ft, 0 8O&US&07OS 1 UCfettiiTfeO, H«(D 

[0 12 2] MSgfltlt 06 OS 2^itt?/ci6^V 

(s30) o [i. 3. 2. i] ^mALrmmcm? 

5x*;I/^-C Cm, S ) f £ [!. 3> 2 . 2] 
ALrc^flROjttSA^fcBSI-rsx^l/^D cm. s) 

^3Wffij£*:ftT5 (S3 1) 0 [1, 3. 2. 3] 
ALfcix^;!/^ A C (m. s) f+D ( m , S ) f 
^nt'fcO, [1. 3. 2. 2] -C#ALfcij*/|]^ 

+ ^?E 0 Cm. s) J)+El Cm 

f Cm, s) ( s = 0, 1, 2, 3) ^;Ri63 (S2 

i) o ^*«*fl=tt [i. 3. 3] v^temmmmm 
Mo^Mjn§ 0 ccom, ai7, 1 8*^-r<t5 

fc, »mL/^;l/K*5W*BJ^««*m- 1 U^jKDZtl 
[0 12 5] — ^f, Rl— L/^UrttC*5ttS7jc^PW#Bat 

fT^tl^o [1. 3. 3] ^S20(7)l^<, f 
Cm, 3) Cm, 2) J- ^ f Cm, 2) £ f 

Cm, 1 ) IC, f Cm. O ti f Cm, O) ^tl^ 

loTt, S ^ fc t fe f: R i; ^ i: ^BiflKtc 
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[0126] mmcft&bz^ f cm. o) {co 

*ft^Tf cm. o) 5:-0gft5i:l^fl^i 

ofco 0 tC s = 4 ^{^AU f Cm. 4) 

*rfc*f cm. o) i:-r^Ci:{cl¥Lv\ f cm. o 

hi cm. 3 > <Dmmmi>m<%:9m€zmfa*®m.? 

% fc ®T*& K> . C commie «fc o T5U&*SSft<«fc D 
&ofc„ clojgB^D*, [i. 7. l] icfjK 

scrt teas zummz ? L<Dmmm*mmcu-?m'g 

[1.7] T«tfcOTS5 0 

[0 1 2 7] 01 3l£m0ly<Mcl3^Tgtmm*®:fe 

T?>m7-^irmv&^ 0 mo ^^iT^wm^rc 
f co. s) ^-<x^mmcmmm^m^^ a hi 

4 Itm l U^KCfeV^TSW^^^-r^^^-rH 
T&3 0 Mil U^l/TfigiJHffj^n^'tx 4 Hffi 

f/?J Btlicft^'l MXtfUGK T?^ $ n T ^ 5 „ 
p ci. s) x cottfcSZ q Ci. s) cocjz, 

CO 1 2 8] 1. mi U^>l<<DMmmT*&x<DtE±& 

2. ^a~d^Oi:oi(BV>^yK o$DIOM;Mc 

3. mo^^T*-rT^C*$oTV>§H*A~D(D^J5S 
£A' ~D* £q Ci. s) ©cfiK^ny hf-So |tfij|g 

Iff] UffiKHc & § t © fc t § 0 

4. H*AC0cfKD^aO*tJS^a' tfjffijRA' (D$>lz& 

H*A©(£T?£4&5ttH (lO^ tf-p) t, j*U* 
AW* A ' £D * ? § {SB |H| U T * § £ fS/Sf S o 

5. 4 i:|BJ«cD^ST-m^b' ~d' ^DyhU 

^a' ~d* v^mmmm^?> 0 

CO 1 2 9] JW±A^5^xO*fJES^©9fe^#«gT* 

5tCiIJJKA' ~D' <Dmm&^T^<ffi5fflif£*Et 
5o 



[0 1 3 0] CoLT, h%mml"^;l(D 4-D(DmWi^ 
tf&mtltf, m^k^yj V ^> h L (H120S2 

2) , mA' i n^:ex.TV^l>C t^Mti^X (S 2 

3) , s 2 1 fcMSo j^t, s 2 1 icmztzuicxmic 
m^i^mmm<Du^;KDMmm^n>, mm^s 2 1 tc 

^ft<h tfcgln U-^;l/CD^:{f! f Cn) 
cn) (^ = 0) i:#< 0 

[0131] -^mcm&zrticmtz^m&jZkbz^ 

4) o ffitt r, wmyztDmrnttw oir| inax ^t 

l^&^Cil^lMgL (S 2 5) % S 2 1 (CMD, 
rjiCfflLT^ftf (") ( r? = Arj) ^*^§ 0 COSa 
IJ^DjSL, S2 1T'f (n) ( rj = i A ?j ) (i = 

0, 1, -) £*i6T^< 0 ^^a^Siftit 

s 2 6 tcji^ ^iEco^-e»)g^ tj = t] 0 p t ^i*jg 

U f Cn) (lJ = 7/ 0 p t ) *«ijSFfl</fC¥#f Cn) 

[0 1 3 2] H 1 5im 1 2CDS 2 1 ©fiMffl^^D 

So mmmmsbzwk, tmumxiummcticgm 

[0 13 3] mm<DC*£< s SfstA?:-tf'D^iJ7t 
4 (S 2 1 0) „ O^fC, ?©^OA(CO^T (*j«fc 

Cm. s) ^.^^ (s 2 1 1 ) , cti* f 

cm. S ) (a = o) tm<c m&2>UcM-?Z'%®$> 

mm?\w<om\ ma x z&z.t^%^c t«iL (s 

2 13), S2 1 11:^0, WKOSSOigLftLa-Cf 
Cm. S ) (A=iAA) (i = 0, 1, •••) ^rj}<46 

§ = A *^ ma x *SAfti:t S 2 1 4fCit^ v gjg^; 

A = A opt *«a£U f Cm - s 5 (A = A opt ) 

*«Bf«HC^flRf Cm. S ) (S2 1 4) 0 

[0 13 4] o^fc, — P-^;Kc*5ltSflfi©6liJ5?#^ 

■S>(S2 15) 0 s *M^:Sx.Tl/^l/^C t^rfiSigL 
(S216), S 2 1 llcMZo s = 4 (C^nif ±M<0 
f Cm, 3) ^IjfflLTf Cm. o) ^gfft, 

[0 13 5]816I4, feSmtstCOWA^^ 

^s^en^f cm. S ) ( a = i a a ) (i=o, 

1. ••■) l£ftj£\'?Z>3i%.;]/3f : —c Cm. s ) CD^Kj^r 

^-THT-feSo [l. 4] T-x&^fctisO. Atfmim? 

ztmnc cm, S ) f {±js^f* 0 la -1 l, Atf«a 
imm^^tc cm. S ) f (iiuftifcigus. fcf* 
suffisw-etic cm. s > t&mM&&k.zk.z<K>xit 

A 0 p t i:?*i6S 0 (W1HOJ; 3fcA>A opt cd|5H"c? 

SSC Cm. s) f *VJ^<^ t ,TV^Tfe, ^OB#* 
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[0 13 6] il 7(i, r] Z&tbZtl 

/ifCn) (r)=iAr?) ( i=0 1, •-) (C^fjCS-T 

eii 7im4<Dffim<D-eTntti5:*&jzLrcmtmz.T£ 

[0 13 7] *M^ftffitcJ;nffa^cD^ V v h 

>y * ^ -7(om%:&ffi<Dmmitmm t* # s . s ^ 
-a- s n s * y *j x » h tc § ^ w&£nii t ^ 

Wf^% A*M(C@^-r 5 llifiji^a! */ X -r A ©#t^ # njftg 
[0 1 3 8] £45, *HU*iS«{COV>T^<DJ:3^:^ 

( i ) iviM&mvit^mMmmtm^mmm<D\®x- 
[0139] ttt*.a2ft<ommBi-v. mm<m%&.n%. 

E tot =aE 0 + E 1 *^fPflffiiCi:-r5o 
''j-ft^^toSo fn5)0'?iO^, a fc: [MI L T E , ^ 

* — # tc 5 mc mm& m (dmm v 

[0 l 4 0] unWWcfcffp<ffiS;cO^(C{±v>5l.^J5: 
75rS£ft<&D, m(fi/E,i:i/E 2 ())J;v(c, fPffi 

*ft (n = 2. 1/2, -K , ffi 

[0 l 4 l] a£>^ HijJSSWOil^ < 

fe«fcv\, /^^-^A^3W±©^«t>i:o-ro^k^ 

[0 l 4 2] (2) *M*iSffiT-«, ^iHffffii^fl^ 



*/Nc&§ «fc o mmimtciks m^mmizzmf&tz 
'Ni^S/Nc & § <t 3 (c/^ * — £ ^«6t t, t 

S§o ^<Dm^ m%.l£ a E 0 + /3 E , fcl&^iMSjS £ 
U a + 0 = 1 *SftJ^*fl=%taitT*ffPflBie*^Jc 

& 46 T 1/ > < j&{ c <g, § £ T* § o 
[0 14 3] (3) HU^We«#«?^f!jaix^;l/T4a 

»« i ffs^fcwr^4aw(7)iijia«^^ fi icL/co l& 
§miT-fen«\ ffiA^fcH-r^ f cm. 3 ) ^fvm 

[0144] (4) *W«SflfT»tt1fa^[7^;l/^{i:«J: 

{£ 3 X 3 Tf 1 7"D 7^tU ^«^T'#S^^St-^ 

[0145] (5) Ph&m»tmmmwti9-<Dt% 

ift-rSo ^ni-Xno^ffii: LT, R G BtD&fiJtSXco^ 
[0 14 6] [B^^^/c«a#fflP^(CWr§Sliffi<D 

[0147] %mmm 1 

01 8t±, *-7^-i>,T^ii«i] 1, w,zmm 
1 2^-^l, ?n?>oraT', fe^iip , ( x , , 

y x ) tp 2 (x 2> y 2 ) A^JSLTV^o Ctl?>cD 
[0 14 8] 01 9« s ^lltl \±.K*yz/ a.*® 

§0 Ctl?) 4flcD^g : ?^A, B, C, Dlt, 018tC^ 
A' v B' , C , D* ^WL, cn?>O^T«?tl 
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mmiLvm 1 mm i 1 tig 2 mm 1 2 ©*fisra«£SBai 

co 1 4 9] w^7 7"C;wiMiiii«i 1 tmzmm 

zctic^o, ffi*©B# m&3&m<Dtpmmm*£i£Tz 
%o LfctfiT, m\mm \ u mzmmi 2, is&xs 

[0 1 5 0] 02 oimmtiyr^/ifrzfa^&iwcr) 

2 0T-{±, Hi 9»fjJyR l ©T^lcStes 
ELf'iBA BCt, |H|«k:«F^U =T>R 2®T^fCfe 
fcSHftJBA' B' C fcOM^t. l^SU igj£# 
U 3>m<D=ftiBA B C l*)f^O^Q^\ Sl^AC^t : 

(1-t) (Cf^U ^-cDrtShSijSB coPfl^s : (1 
-s) ICfafttZfamiCZb-otcttZe iKDjSQOM 
#U :f>{jiiJ<DHj%©A' B' C (CfcttSSffS^Q' " 
«, Uiiyj-A' C £t : (1-t) tcp^U -?-cD|*j>)- 
^i&B' cDflg^rs : (l- s ) leftftt '5f3Bfc&3 

BQ= (l-s) { (1-t) BA+t BC) 

B' Q' = (1 -s) { (1 - t) B' A' + t B' 
C } 

[01 51] 02 1 &,±(Dmmm\m^To 

1 9ocri:< 1 nitti 1 ±icmt>nrcfa?&icMf 

zw*>wnm&9m+z (s 1 0) „ c<otft. m 

m&m&m ^-rtcfteov y > ar* r-^ * 

ij >l y a - Jf> >y ^ v <y + y >? % & t ic&^mc 

[0 15 2] O^T, 01 9 H2H 
ft I 2±fc^^Urf>^«-r^, (s 1 2) . «±T? 
*tl££ 7rY T £ § © t\ c © 7 y >f ;b £ fg i 



Hft 1 1, mzmmi 2*mmtzrctb(Dmm*&9# : 
^T-m7J•r^ (s 1 4) „ *fco©H»*j:tf#iSjS7 

[0153] 12211 tti&&7 r << ;izm^Tfpmm 
m*£.i&-r%¥m*K* 0 s-r, ^uti k 312 h 

ft I Zffm&&£tl (S2 0) , M6«57?YM% 
ii^ni. (S2 2) 0 e^U^rtCD^i: 
»JS# 'J =f>F«3<D^<DMJESM#A^0 2 0 CD73ffifC J; o T 
IStfJSnS (S2 4) 0 C£>B$j£T\ BftF*J<D-f^TcQ 

ffitsi:^^ u : ( 1 - u ) -crt«-rn«\ mi mm 1 1 
hmzmmi 2 cora^^^fc ( 1 - u ) : u t-w^-t 

5fiH^*5^«^KIBfi!^^-rsc: ttf-U%% (S 2 
6) . ^4b% F«3#ffiM^J-e* < , ^#MK*LTfcJ; 

[0 15 4] 02 3(iJX±<Oma^ff5H!«ift^SBl 

zim 2 mm 12^5 ^irasft^^-r * tfifflwus^gp 

i8i: 1 ^iiin > g2BSi2 *J<k0 t if'WiB'»* 

^■T-5*^g|52 O^Cfo $fc, ii«3P2 2«, ^g|3^ 
60Bfafc Sliil K 35 2 Mft I 2 fej; 

Zfttfoti 77^/bF^7h7-^ •?■ ©fflOfE^f' > 7 

■5^\Stti-r^o v-yfy^nt-yf 1 4[C«, 
^ «y n. (D± t $ ^t&^OteH* if ^ y 2> a fflf 

[0 15 5] W±o««jcj:»), HfiAT^l 2(cA^ 

?nfca? 1 aft 1 1 tm 2 mm 1 2 tivyfyyynt 

f>y7 P Dt 7 D-14(^7i'a ff tt(C WJES^ 7 
[0 15 6] tflfflB«^BPl 8{±, 3.— WMiblcm 

^c-eiaftfcB^oBtfa^^ff^n, Ka^fc 

l 0i;{igiJ«^©';-E-h4iB*ffl!jfj:fe- 3 Tt«fc<, 
^ok* 5 s i aft i k m 2 aft I 2 , WlS^ 
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[0 15 7] Mm&2 2l**<Dfcib<Dmi&T'&t), do 

*Cfc*igjgLT^*o ffcfeti, iiffgP2 2{±Jg 1 B 
ft I K mzm^lZ, ^7r^l/F^7h7- 

•V h , 7-^c0^gp^C ) ilffg|5 2 2£/rLT3flB{in 

[0158] mmmmi (omm^mic-D^rmm^n 

r>fzt£?>, mi. mzmmtLX, WM2 5 6X2 
^tfHi+D^G i o + n/W SSST-feD, B 

[0159] ■Mm.comm ?. 

$.32 v«Dmm*m immi u m 2 mm 1 2 1 u •?• 
2^*«^Wiwr« ctT36o° J»sfr*iuiteji!ij#,!,< 

t&ffi*fflm?ZZL£T;\ Z.<Dftm*l 0-2 0° fCT"^ 
[0 16 0] ffio a p|f^«(i x Hd6©iB«gi i;H&D, 

fflii *co^^(i\ BftA77gi5 1 2i±mimmi m 

2mm l 2©S^{C, ^77^l,FW|t§ 0 C 

?n^ 0 ^B#«^gp2 ovm^titco. mmm 

•9-1 4 ti**S^7r-r;Pfia*»i 6WgT$§„ 4 

[0161] mshm^mm^ mmmm 1 ican*, n 



[0 16 2] «|gO@iJcDf?ij^LT, Bp a pBft^-77lp](C 

«77 f^tc «, t rstmcmz?* ctiz£*) s mjjfamli 
mxmc&MmTtzcttfTzze commit 

(1) Slit, %2W&fr£>%:%m&ftAb^ ^tiZ 

(2) m3mm, mAmmfrz&zmmttB znz 
2 ®.(om{m<Dttm&m m ^wif§n 

(3 ) h«*t a <d 2 fr<Dwmmmm(ti$.rci*Qmmc 

[0 16 3] (3) fcfe^T, WlA^W|B^iJfflLT2 
WffiK (bilinear interpolation) ^ffo Tt> «fcV> 0 — 
^iJttLT, 2-^OMpl (0, 0) , p2 (0, °1 0 
0) ^S»feH«B*AfcU BlJ0 2 00S£ P 3 (1 0 
0. 0), p 4 (10 0, 1 0 0)^f/cj(|!^Bt 

■rso * p 1 1 p 2 mz&mmm&A. & P 3 1 P 4 % 

[0 1 6 4] ffP^Bff fcLT, ft£p '=(5 0, 5 
0) *»6SfeiMR*W*«^, SflS«*fAO|BI<0»|£ 
J^WffiA*ti;fcS^ (0, 5 0) *f.C7l/-^4 
fig-T « c o ^{c B#*f B <Dmottft£1fMH B * 1 1 {Cfli 
,^(10 0, 5 0) ft^OgiJ(D7U-A*4fiJi-r«o o 

-*>C<Dm&\ : 1WU R/rSocfP^ 7 U-AA^ 
^n§o *K««Pi7J|fiii©Mlffl*-r5fe46{i:(i, - 

isfc ma titfiB &m-mm± tc^^^a B#*f a 
[0 1 6 5] co#ijT(ittA, wb«, ^-n^n 

f?!lfe$.i>o /ci:^^\ 0-t-D(Dm.&PfrP>f%M t = t 0 
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